Jul 06 14:14:57.330231 ip-10-0-139-175 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.634738    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640486    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640502    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640505    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640509    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640512    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640515    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640518    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:14:58.701589 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640522    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640525    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640528    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640530    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640533    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640536    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640539    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640542    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640547    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640550    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640553    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640557    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640559    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640563    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640565    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640568    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640570    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640573    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640576    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640579    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:14:58.703082 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640582    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640584    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640587    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640590    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640594    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640597    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640600    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640603    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640605    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640608    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640611    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640614    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640616    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640619    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640621    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640624    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640627    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640629    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640632    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640636    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:14:58.943453 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640639    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:14:58.706654 ip-10-0-139-175 systemd[1]: Started Kubernetes Kubelet.
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640641    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640644    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640648    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640651    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640654    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640656    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640659    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640662    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640665    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640668    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640670    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640673    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640677    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640679    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640684    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640687    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640690    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640693    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:14:58.957485 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640697    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640702    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640705    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640708    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640711    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640716    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640720    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640723    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640726    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640729    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640732    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640734    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640737    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640740    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640742    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640745    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640747    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640750    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640753    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:14:58.958844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640755    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640758    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640761    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640763    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640766    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640768    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640772    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640775    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640777    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640781    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640784    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640786    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640789    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.640792    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641551    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641559    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641562    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641566    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641568    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641571    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:14:58.959800 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641573    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641576    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641579    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641582    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641584    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641587    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641589    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641592    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641595    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641597    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641600    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641603    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641606    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641608    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641611    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641614    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641616    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641619    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641622    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641624    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:14:58.960768 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641627    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641631    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641633    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641636    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641639    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641641    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641644    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641646    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641649    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641651    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641654    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641656    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641659    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641661    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641664    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641666    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641669    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641672    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641674    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641677    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:14:58.961422 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641679    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641681    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641684    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641687    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641690    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641692    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641696    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641699    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641701    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641704    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641706    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641709    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641714    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641719    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641722    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641725    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641728    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641730    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641733    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:14:58.962063 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641736    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641739    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641741    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641744    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641746    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641749    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641752    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641754    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641757    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641759    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641762    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641764    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641767    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641769    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641772    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641774    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641777    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641780    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641783    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:14:58.962809 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641787    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641790    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641793    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641795    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641798    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641800    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641803    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641807    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641811    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641814    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641818    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641822    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641825    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641828    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.641831    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642218    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642223    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642226    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642229    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:14:58.963384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642232    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642234    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642237    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642239    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642242    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642244    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642247    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642250    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642253    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642255    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642258    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642260    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642263    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642272    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642275    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642278    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642281    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642283    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642286    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642289    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:14:58.963916 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642291    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642294    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642297    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642300    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642304    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642307    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642310    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642312    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642315    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642317    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642320    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642323    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642325    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642328    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642330    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642333    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642335    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642338    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642341    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:14:58.964507 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642343    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642346    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642348    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642351    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642353    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642356    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642360    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642363    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642366    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642369    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642371    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642374    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642376    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642379    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642396    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642399    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642401    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642404    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642407    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642409    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:14:58.965009 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642412    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642415    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642418    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642421    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642423    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642426    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642429    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642432    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642434    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642437    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642439    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642442    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642444    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642447    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642450    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642452    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642455    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642459    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642463    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642469    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:14:58.965561 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642472    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642474    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642477    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642481    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642485    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642487    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642490    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642493    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642496    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642500    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642503    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642506    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642509    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642512    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642515    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.642518    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642586    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642598    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642604    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642609    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 14:14:58.966147 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642613    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642616    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642620    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642625    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642628    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642631    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642634    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642638    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642641    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642644    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642648    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642652    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642656    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642659    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642663    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642666    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642669    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642672    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642675    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642679    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642682    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642685    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642688    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642691    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 14:14:58.966647 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642694    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642697    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642701    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642704    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642708    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642711    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642714    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642717    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642719    2581 flags.go:64] FLAG: --enable-server="true"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642722    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642727    2581 flags.go:64] FLAG: --event-burst="100"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642730    2581 flags.go:64] FLAG: --event-qps="50"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642733    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642736    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642739    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642743    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642745    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642748    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642754    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642758    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642761    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642764    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642767    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642770    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642773    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 14:14:58.967229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642776    2581 flags.go:64] FLAG: --feature-gates=""
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642780    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642783    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642786    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642789    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642792    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642795    2581 flags.go:64] FLAG: --help="false"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642798    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-139-175.ec2.internal"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642801    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642804    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642807    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642810    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642813    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642816    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642818    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642821    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642824    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642827    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642830    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642832    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642835    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642838    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642841    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642844    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 14:14:58.967884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642847    2581 flags.go:64] FLAG: --lock-file=""
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642851    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642855    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642858    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642864    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642867    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642870    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642873    2581 flags.go:64] FLAG: --logging-format="text"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642876    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642879    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642882    2581 flags.go:64] FLAG: --manifest-url=""
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642885    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642889    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642892    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642896    2581 flags.go:64] FLAG: --max-pods="110"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642899    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642902    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642905    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642907    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642911    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642914    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642917    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642924    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642927    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642930    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 14:14:58.968486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642933    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642936    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642942    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642945    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642948    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642951    2581 flags.go:64] FLAG: --port="10250"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642954    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642957    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0489a8edc3c49a74c"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642961    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642964    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642968    2581 flags.go:64] FLAG: --register-node="true"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642971    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642975    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642978    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642981    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642984    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642988    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642991    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642994    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.642997    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643000    2581 flags.go:64] FLAG: --runonce="false"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643002    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643005    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643008    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643011    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 14:14:58.969098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643014    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643017    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643020    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643023    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643026    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643029    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643032    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643035    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643038    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643040    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643043    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643049    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643051    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643054    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643058    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643062    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643065    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643069    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643072    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643075    2581 flags.go:64] FLAG: --v="2"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643079    2581 flags.go:64] FLAG: --version="false"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643083    2581 flags.go:64] FLAG: --vmodule=""
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643087    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.643090    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 14:14:58.969767 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643205    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643210    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643213    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643216    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643219    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643222    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643225    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643227    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643230    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643233    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643235    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643238    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643241    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643243    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643246    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643249    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643252    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643254    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643257    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643259    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:14:58.970365 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643262    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643264    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643267    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643271    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643273    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643278    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643281    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643283    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643286    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643288    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643294    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643297    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643299    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643302    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643305    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643307    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643310    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643313    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643315    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643318    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:14:58.970888 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643320    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643323    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643326    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643328    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643331    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643333    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643336    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643338    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643341    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643343    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643346    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643349    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643351    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643353    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643356    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643359    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643362    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643366    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643369    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:14:58.971496 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643371    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643374    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643376    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643379    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643396    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643399    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643403    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643406    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643409    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643412    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643416    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643420    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643423    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643426    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643429    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643431    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643434    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643437    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643439    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:14:58.971958 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643442    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643444    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643447    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643449    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643452    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643455    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643457    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643460    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643462    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643466    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643469    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643473    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643475    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643478    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643481    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643483    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643486    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643488    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643491    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643494    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:14:58.972458 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.643497    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.644181    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.654525    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.654543    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.654563    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.654573    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654642    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654648    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654652    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654655    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654658    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654661    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654665    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654668    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:14:58.972948 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654672    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654675    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654678    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654681    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654685    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654688    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654691    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654694    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654697    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654699    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654702    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654705    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654708    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654710    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654713    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654716    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654719    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654722    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654725    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654728    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654731    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:14:58.973307 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654734    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654736    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654739    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654742    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654744    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654749    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654752    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654756    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654758    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654761    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654765    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654769    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654772    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654775    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654778    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654781    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654784    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654788    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:14:58.973840 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654791    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654795    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654798    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654801    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654803    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654806    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654809    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654816    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654818    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654822    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654825    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654828    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654831    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654834    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654836    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654839    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654842    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654845    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654847    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654850    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:14:58.974281 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654853    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654856    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654859    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654862    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654865    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654867    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654871    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654873    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654876    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654879    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654882    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654884    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654887    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654895    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654897    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654900    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654903    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654906    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654908    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654913    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:14:58.974776 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654916    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654918    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654921    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654924    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654927    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654930    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654932    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654935    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654938    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654941    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654943    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.654946    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.654951    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655116    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655120    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 14:14:58.975287 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655123    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655126    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655129    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655132    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655135    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655137    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655140    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655143    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655146    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655149    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655153    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655156    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655159    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655162    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655166    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655170    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655173    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655177    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655180    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 14:14:58.975679 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655183    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655186    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655190    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655193    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655196    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655199    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655202    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655205    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655208    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655210    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655213    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655217    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655219    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655222    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655225    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655227    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655230    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655232    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655235    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655237    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 14:14:58.976133 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655240    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655243    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655245    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655249    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655252    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655254    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655258    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655260    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655263    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655266    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655269    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655272    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655276    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655280    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655282    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655287    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655290    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655293    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655295    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 14:14:58.976640 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655298    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655301    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655303    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655306    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655309    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655311    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655314    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655318    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655322    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655324    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655327    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655329    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655332    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655335    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655338    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655340    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655344    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655346    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655349    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655352    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 14:14:58.977098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655355    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655357    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655360    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655364    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655366    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655369    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655371    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655374    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655377    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655400    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655403    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655406    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655409    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655411    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655414    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655417    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655419    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655422    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 14:14:58.977618 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:58.655424    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.655430    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.655533    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.658947    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.660159    2581 server.go:1019] "Starting client certificate rotation"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.660300    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.660334    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.662529    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.664108    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.673191    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.675248    2581 log.go:25] "Validated CRI v1 image API"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.676637    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 14:14:58.978072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.679446    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e92d0bf3-03e2-427a-a5a8-8b6af62a6e52:/dev/nvme0n1p4 ff040793-f1b5-4c8f-969f-8882344e4c8f:/dev/nvme0n1p3]
Jul 06 14:14:58.978381 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.679496    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.687605    2581 manager.go:216] Machine: {Timestamp:2026-07-06 14:14:58.685870259 +0000 UTC m=+1.252777894 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098986 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a923fa5d24404709fd674463e3afd SystemUUID:ec2a923f-a5d2-4404-709f-d674463e3afd BootID:79ae7999-82aa-4e6e-a3eb-83d62219733d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d6:ef:9e:23:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d6:ef:9e:23:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:78:0a:46:ff:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.687708    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.687786    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.688720    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.688746    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.689803    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.689813    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 14:14:58.978450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.689822    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.690488    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.691925    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.694707    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.694839    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695408    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695423    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695441    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695450    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695460    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695790    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.695805    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.698312    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.700291    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.700331    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701404    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701422    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701438    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701449    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701464    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701472    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701482    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701488    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701496    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701503    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701530    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.701546    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.702153    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.702162    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.704124    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.705538    2581 server.go:1268] "Started kubelet"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.705579    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.705687    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.706004    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.707727    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.708253    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.709229    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.709271    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.709333    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 14:14:58.978678 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.710677    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.713898    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.713912    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.714676    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.714687    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.714705    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.714639    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.715061    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.715070    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.719763    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.720020    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721020    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721034    2581 factory.go:55] Registering systemd factory
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721041    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.720207    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-175.ec2.internal.18bfb8eb6a7e9623  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-175.ec2.internal,UID:ip-10-0-139-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-175.ec2.internal,},FirstTimestamp:2026-07-06 14:14:58.705511971 +0000 UTC m=+1.272419584,LastTimestamp:2026-07-06 14:14:58.705511971 +0000 UTC m=+1.272419584,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-175.ec2.internal,}"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721249    2581 factory.go:153] Registering CRI-O factory
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721263    2581 factory.go:223] Registration of the crio container factory successfully
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721289    2581 factory.go:103] Registering Raw factory
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721301    2581 manager.go:1196] Started watching for new ooms in manager
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.721962    2581 manager.go:349] Starting recovery of all containers
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.735341    2581 manager.go:354] Recovery completed
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.739677    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741466    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741501    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741511    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741971    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741983    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741998    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.741974    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.742662    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.742688    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.742699    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.743165    2581 policy_none.go:49] "None policy: Start"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.743178    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 14:14:58.979665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.743188    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.743841    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-175.ec2.internal.18bfb8eb6ca38337  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-175.ec2.internal,UID:ip-10-0-139-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-175.ec2.internal,},FirstTimestamp:2026-07-06 14:14:58.741486391 +0000 UTC m=+1.308394004,LastTimestamp:2026-07-06 14:14:58.741486391 +0000 UTC m=+1.308394004,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-175.ec2.internal,}"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.744446    2581 policy_none.go:47] "Start"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.751433    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4hld6"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.755158    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-175.ec2.internal.18bfb8eb6ca3ce18  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-175.ec2.internal,UID:ip-10-0-139-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-175.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-175.ec2.internal,},FirstTimestamp:2026-07-06 14:14:58.74150556 +0000 UTC m=+1.308413172,LastTimestamp:2026-07-06 14:14:58.74150556 +0000 UTC m=+1.308413172,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-175.ec2.internal,}"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.759448    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4hld6"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.779950    2581 manager.go:337] "Starting Device Plugin manager"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.779983    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.779998    2581 server.go:87] "Starting device plugin registration server"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.780352    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.780365    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.783645    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.783766    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.783778    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.784933    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.784990    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.842607    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.843812    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.843848    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.843872    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.843906    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.846827    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.881079    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.881954    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.881990    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.882008    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.980536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.882034    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-175.ec2.internal"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.893256    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-175.ec2.internal"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.893276    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-175.ec2.internal\": node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.945508    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"]
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.945580    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.946402    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.946427    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.946437    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.947963    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948094    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948640    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948668    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948674    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948697    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948709    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.948679    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.950468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.950489    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.951152    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.951176    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:58.951200    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeHasSufficientPID"
Jul 06 14:14:58.981182 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.953034    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:58.985078 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.985061    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-175.ec2.internal\" not found" node="ip-10-0-139-175.ec2.internal"
Jul 06 14:14:58.989465 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:58.989449    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-175.ec2.internal\" not found" node="ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.016929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.016900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20d14cc84bd98b880505d2dcf2acf4e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal\" (UID: \"20d14cc84bd98b880505d2dcf2acf4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.017033 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.016932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20d14cc84bd98b880505d2dcf2acf4e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal\" (UID: \"20d14cc84bd98b880505d2dcf2acf4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.017033 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.016951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b495462a2361679d3c36d9506f0a53c2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-175.ec2.internal\" (UID: \"b495462a2361679d3c36d9506f0a53c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.054090 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.054041    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:59.117541 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.117512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20d14cc84bd98b880505d2dcf2acf4e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal\" (UID: \"20d14cc84bd98b880505d2dcf2acf4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.117616 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.117546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20d14cc84bd98b880505d2dcf2acf4e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal\" (UID: \"20d14cc84bd98b880505d2dcf2acf4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.117616 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.117565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b495462a2361679d3c36d9506f0a53c2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-175.ec2.internal\" (UID: \"b495462a2361679d3c36d9506f0a53c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.117676 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.117617    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b495462a2361679d3c36d9506f0a53c2-config\") pod \"kube-apiserver-proxy-ip-10-0-139-175.ec2.internal\" (UID: \"b495462a2361679d3c36d9506f0a53c2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.117676 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.117616    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20d14cc84bd98b880505d2dcf2acf4e0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal\" (UID: \"20d14cc84bd98b880505d2dcf2acf4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.117676 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.117616    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20d14cc84bd98b880505d2dcf2acf4e0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal\" (UID: \"20d14cc84bd98b880505d2dcf2acf4e0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.154589 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.154562    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:59.255405 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.255383    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:59.288099 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.288077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.293124 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.293100    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.355660 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.355626    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:59.456092 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.456069    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:59.532139 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.532083    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:14:59.556184 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.556165    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-175.ec2.internal\" not found"
Jul 06 14:14:59.627510 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.627486    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:14:59.659925 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.659904    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 14:14:59.660059 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.660017    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:14:59.660116 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.660057    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:14:59.660116 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.660068    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 14:14:59.696228 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.696204    2581 apiserver.go:52] "Watching apiserver"
Jul 06 14:14:59.714181 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.714153    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 14:14:59.714181 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.714178    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 14:14:59.714850 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.714725    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.715093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.715072    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh","openshift-cluster-node-tuning-operator/tuned-kz5g2","openshift-dns/node-resolver-dmrjt","openshift-image-registry/node-ca-znkxk","openshift-multus/multus-additional-cni-plugins-mzmtk","openshift-multus/multus-hpk5l","openshift-network-operator/iptables-alerter-8s5rt","openshift-ovn-kubernetes/ovnkube-node-vmsx7","kube-system/global-pull-secret-syncer-xdc2z","kube-system/konnectivity-agent-z47mb","openshift-multus/network-metrics-daemon-z2h7k","openshift-network-diagnostics/network-check-target-jwxrg"]
Jul 06 14:14:59.716264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.716248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.717137 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.717117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.718255 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.718237    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.719195 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.719180    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.720226 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.720214    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.721187 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.721173    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.722589 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.722573    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.723528 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.723514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.725043 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.725026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.725265 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.725089    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.726172    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.726558    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.726965    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.726988    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6drsq\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727135    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727223    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727437    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727448    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727555    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727655    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727679    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727711    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727727    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727837    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727858    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727894    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.727950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727921    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727928    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728046    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qwnnc\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728262    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728321    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728390    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-659kj\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728454    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7cmzj\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.727842    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728635    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 14:14:59.728725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728711    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g7fbp\""
Jul 06 14:14:59.729092 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728799    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.729092 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728870    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hknmx\""
Jul 06 14:14:59.729092 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.728931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 14:14:59.729862 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.729379    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 14:14:59.729862 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.729436    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xnkcl\""
Jul 06 14:14:59.729862 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.729379    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xw66d\""
Jul 06 14:14:59.729862 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.729503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.730064 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.730048    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 14:14:59.730837 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.730819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:14:59.730978 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.730959    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:14:59.732018 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.732004    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:14:59.732062 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.732051    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:14:59.736245 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.736227    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p7jl8\""
Jul 06 14:14:59.736340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.736273    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 14:14:59.736340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.736233    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 14:14:59.744060 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.744045    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:14:59.744117 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.744104    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"
Jul 06 14:14:59.745547 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.745530    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal"]
Jul 06 14:14:59.755797 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.755780    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal"]
Jul 06 14:14:59.756121 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.756107    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 14:14:59.760995 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.760945    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 14:09:58 +0000 UTC" deadline="2028-04-16 09:29:53.48521927 +0000 UTC"
Jul 06 14:14:59.760995 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.760993    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15595h14m53.724228354s"
Jul 06 14:14:59.775801 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.775780    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tv6rh"
Jul 06 14:14:59.784802 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.784735    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:14:59.785568 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.785552    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tv6rh"
Jul 06 14:14:59.816058 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.816033    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 14:14:59.821047 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-sys-fs\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.821047 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821050    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysconfig\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821064    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-var-lib-kubelet\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821083    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821104    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-system-cni-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821137    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-os-release\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821151    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-run\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821173    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-kubelet\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-run-netns\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.821300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-var-lib-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4a75ec-0842-4829-be3c-89e3efd08144-tmp-dir\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htxbb\" (UniqueName: \"kubernetes.io/projected/ec4a75ec-0842-4829-be3c-89e3efd08144-kube-api-access-htxbb\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-k8s-cni-cncf-io\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821439    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htqd9\" (UniqueName: \"kubernetes.io/projected/faccf60e-998c-4f50-9a38-3de692c2dec1-kube-api-access-htqd9\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821460    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-ovnkube-script-lib\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-hostroot\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-conf-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-daemon-config\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e59933d-c3b8-4194-8f04-535378325b87-host-slash\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-sys\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-node-log\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821677    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-ovnkube-config\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-device-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.821737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-system-cni-dir\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63370ee-d317-4d56-ac8e-8df54e89dd86-serviceca\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821768    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-cni-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7bkc\" (UniqueName: \"kubernetes.io/projected/bf96da50-055a-499c-82b8-9b394b9dcd3c-kube-api-access-s7bkc\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-cni-netd\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-env-overrides\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-os-release\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85k7f\" (UniqueName: \"kubernetes.io/projected/5edd22db-2cf0-4489-9044-dcde40c1e7fd-kube-api-access-85k7f\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysctl-d\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-lib-modules\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.821990    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/577ddb13-6c27-4629-88a2-e8c1cb011435-tmp\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-systemd-units\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822026    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec4a75ec-0842-4829-be3c-89e3efd08144-hosts-file\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-systemd\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.822264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-socket-dir-parent\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e59933d-c3b8-4194-8f04-535378325b87-iptables-alerter-script\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/161ba2bc-42f7-45ff-b323-199ac408eb75-dbus\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acdd6b44-230e-43ad-8d67-1d846d9c7c80-agent-certs\") pod \"konnectivity-agent-z47mb\" (UID: \"acdd6b44-230e-43ad-8d67-1d846d9c7c80\") " pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faccf60e-998c-4f50-9a38-3de692c2dec1-cni-binary-copy\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-netns\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-kubelet\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57trs\" (UniqueName: \"kubernetes.io/projected/8e59933d-c3b8-4194-8f04-535378325b87-kube-api-access-57trs\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822295    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xt9t\" (UniqueName: \"kubernetes.io/projected/577ddb13-6c27-4629-88a2-e8c1cb011435-kube-api-access-8xt9t\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-slash\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-ovn\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-cnibin\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.822816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-kubernetes\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-run-ovn-kubernetes\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw4g2\" (UniqueName: \"kubernetes.io/projected/f63370ee-d317-4d56-ac8e-8df54e89dd86-kube-api-access-lw4g2\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-modprobe-d\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822728    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysctl-conf\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7297a7ce-d194-4340-8fec-f938dac1da86-ovn-node-metrics-cert\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822842    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-socket-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-log-socket\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-cni-bin\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.823393 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63370ee-d317-4d56-ac8e-8df54e89dd86-host\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.822988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/161ba2bc-42f7-45ff-b323-199ac408eb75-kubelet-config\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acdd6b44-230e-43ad-8d67-1d846d9c7c80-konnectivity-ca\") pod \"konnectivity-agent-z47mb\" (UID: \"acdd6b44-230e-43ad-8d67-1d846d9c7c80\") " pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823059    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-cni-bin\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823079    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-multus-certs\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-host\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-tuned\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-cnibin\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-systemd\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-etc-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-etc-kubernetes\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bkrl\" (UniqueName: \"kubernetes.io/projected/7297a7ce-d194-4340-8fec-f938dac1da86-kube-api-access-8bkrl\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.824023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823380    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-registration-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.824434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vzfv\" (UniqueName: \"kubernetes.io/projected/ff513b35-d72c-442e-a502-39883daf0636-kube-api-access-6vzfv\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.824434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-cni-multus\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.824434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.823450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.924306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-socket-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.924306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-log-socket\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924362    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-cni-bin\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63370ee-d317-4d56-ac8e-8df54e89dd86-host\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f63370ee-d317-4d56-ac8e-8df54e89dd86-host\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924427    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-log-socket\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924454    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-socket-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/161ba2bc-42f7-45ff-b323-199ac408eb75-kubelet-config\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-cni-bin\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acdd6b44-230e-43ad-8d67-1d846d9c7c80-konnectivity-ca\") pod \"konnectivity-agent-z47mb\" (UID: \"acdd6b44-230e-43ad-8d67-1d846d9c7c80\") " pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-cni-bin\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-multus-certs\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924539    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-host\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.924537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-tuned\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924562    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-cni-bin\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924533    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/161ba2bc-42f7-45ff-b323-199ac408eb75-kubelet-config\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924587    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-cnibin\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924611    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-host\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-systemd\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924632    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-multus-certs\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-etc-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924638    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-cnibin\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924665    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-systemd\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924668    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-etc-kubernetes\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924694    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-etc-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924701    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-etc-kubernetes\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924751    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bkrl\" (UniqueName: \"kubernetes.io/projected/7297a7ce-d194-4340-8fec-f938dac1da86-kube-api-access-8bkrl\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924762    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-registration-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924815    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vzfv\" (UniqueName: \"kubernetes.io/projected/ff513b35-d72c-442e-a502-39883daf0636-kube-api-access-6vzfv\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924834    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-cni-multus\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-sys-fs\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924899    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysconfig\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924936    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-cni-multus\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-var-lib-kubelet\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924949    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.925889 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924980    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-registration-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924998    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925027    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysconfig\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-system-cni-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925056    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-sys-fs\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925070    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-var-lib-kubelet\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925050    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acdd6b44-230e-43ad-8d67-1d846d9c7c80-konnectivity-ca\") pod \"konnectivity-agent-z47mb\" (UID: \"acdd6b44-230e-43ad-8d67-1d846d9c7c80\") " pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-os-release\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925100    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-system-cni-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.925083    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-run\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925139    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-os-release\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-kubelet\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.925189    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:15:00.425153145 +0000 UTC m=+2.992060760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925188    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-run\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.926583 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925187    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-kubelet\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.924824    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-run-netns\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-var-lib-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4a75ec-0842-4829-be3c-89e3efd08144-tmp-dir\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htxbb\" (UniqueName: \"kubernetes.io/projected/ec4a75ec-0842-4829-be3c-89e3efd08144-kube-api-access-htxbb\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925291    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-run-netns\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-k8s-cni-cncf-io\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925312    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-var-lib-openvswitch\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htqd9\" (UniqueName: \"kubernetes.io/projected/faccf60e-998c-4f50-9a38-3de692c2dec1-kube-api-access-htqd9\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925398    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-ovnkube-script-lib\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925411    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-k8s-cni-cncf-io\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-hostroot\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-conf-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-daemon-config\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.927308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925516    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925553    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e59933d-c3b8-4194-8f04-535378325b87-host-slash\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925568    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-hostroot\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925575    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-conf-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8e59933d-c3b8-4194-8f04-535378325b87-host-slash\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-sys\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925642    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-node-log\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-ovnkube-config\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-device-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925713    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-system-cni-dir\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925736    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63370ee-d317-4d56-ac8e-8df54e89dd86-serviceca\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-cni-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7bkc\" (UniqueName: \"kubernetes.io/projected/bf96da50-055a-499c-82b8-9b394b9dcd3c-kube-api-access-s7bkc\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925824    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-cni-netd\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-env-overrides\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.928002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-os-release\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85k7f\" (UniqueName: \"kubernetes.io/projected/5edd22db-2cf0-4489-9044-dcde40c1e7fd-kube-api-access-85k7f\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysctl-d\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925938    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-lib-modules\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/577ddb13-6c27-4629-88a2-e8c1cb011435-tmp\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-systemd-units\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.925999    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-ovnkube-script-lib\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec4a75ec-0842-4829-be3c-89e3efd08144-hosts-file\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926028    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-daemon-config\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-systemd\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-socket-dir-parent\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e59933d-c3b8-4194-8f04-535378325b87-iptables-alerter-script\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/161ba2bc-42f7-45ff-b323-199ac408eb75-dbus\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acdd6b44-230e-43ad-8d67-1d846d9c7c80-agent-certs\") pod \"konnectivity-agent-z47mb\" (UID: \"acdd6b44-230e-43ad-8d67-1d846d9c7c80\") " pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faccf60e-998c-4f50-9a38-3de692c2dec1-cni-binary-copy\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.928735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926169    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-cni-netd\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926189    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-netns\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926200    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec4a75ec-0842-4829-be3c-89e3efd08144-tmp-dir\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-kubelet\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926218    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-sys\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57trs\" (UniqueName: \"kubernetes.io/projected/8e59933d-c3b8-4194-8f04-535378325b87-kube-api-access-57trs\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926263    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-var-lib-kubelet\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xt9t\" (UniqueName: \"kubernetes.io/projected/577ddb13-6c27-4629-88a2-e8c1cb011435-kube-api-access-8xt9t\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926330    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/161ba2bc-42f7-45ff-b323-199ac408eb75-dbus\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-slash\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926383    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-slash\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926140    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysctl-d\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926416    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-cni-dir\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-ovn\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.929474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-cnibin\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926540    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-kubernetes\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-run-ovn-kubernetes\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw4g2\" (UniqueName: \"kubernetes.io/projected/f63370ee-d317-4d56-ac8e-8df54e89dd86-kube-api-access-lw4g2\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-modprobe-d\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926721    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-systemd-units\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysctl-conf\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7297a7ce-d194-4340-8fec-f938dac1da86-ovn-node-metrics-cert\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926825    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8e59933d-c3b8-4194-8f04-535378325b87-iptables-alerter-script\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926832    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-sysctl-conf\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926852    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/faccf60e-998c-4f50-9a38-3de692c2dec1-cni-binary-copy\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926902    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-node-log\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.930167 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926959    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-lib-modules\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.926989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-os-release\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927010    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-cnibin\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927040    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-device-dir\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927042    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-system-cni-dir\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927071    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-host-run-netns\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.927110    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927113    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ff513b35-d72c-442e-a502-39883daf0636-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.927147    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:00.427135451 +0000 UTC m=+2.994043050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927167    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/faccf60e-998c-4f50-9a38-3de692c2dec1-multus-socket-dir-parent\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927242    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5edd22db-2cf0-4489-9044-dcde40c1e7fd-etc-selinux\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927263    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-env-overrides\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927283    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-systemd\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.930866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927314    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-host-run-ovn-kubernetes\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927318    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927378    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-kubernetes\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927453    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-modprobe-d\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927465    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f63370ee-d317-4d56-ac8e-8df54e89dd86-serviceca\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927511    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7297a7ce-d194-4340-8fec-f938dac1da86-run-ovn\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.927548    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec4a75ec-0842-4829-be3c-89e3efd08144-hosts-file\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.928131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ff513b35-d72c-442e-a502-39883daf0636-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.928314    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7297a7ce-d194-4340-8fec-f938dac1da86-ovnkube-config\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.929009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acdd6b44-230e-43ad-8d67-1d846d9c7c80-agent-certs\") pod \"konnectivity-agent-z47mb\" (UID: \"acdd6b44-230e-43ad-8d67-1d846d9c7c80\") " pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.929624    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/577ddb13-6c27-4629-88a2-e8c1cb011435-tmp\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.929998    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/577ddb13-6c27-4629-88a2-e8c1cb011435-etc-tuned\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.931459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.930241    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7297a7ce-d194-4340-8fec-f938dac1da86-ovn-node-metrics-cert\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.940367 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.940271    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:14:59.940367 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.940298    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:14:59.940367 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.940319    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:14:59.940629 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:14:59.940386    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:15:00.440370517 +0000 UTC m=+3.007278130 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:14:59.941017 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.940987    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vzfv\" (UniqueName: \"kubernetes.io/projected/ff513b35-d72c-442e-a502-39883daf0636-kube-api-access-6vzfv\") pod \"multus-additional-cni-plugins-mzmtk\" (UID: \"ff513b35-d72c-442e-a502-39883daf0636\") " pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:14:59.941477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.941453    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85k7f\" (UniqueName: \"kubernetes.io/projected/5edd22db-2cf0-4489-9044-dcde40c1e7fd-kube-api-access-85k7f\") pod \"aws-ebs-csi-driver-node-nmmbh\" (UID: \"5edd22db-2cf0-4489-9044-dcde40c1e7fd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:14:59.942412 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.942386    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xt9t\" (UniqueName: \"kubernetes.io/projected/577ddb13-6c27-4629-88a2-e8c1cb011435-kube-api-access-8xt9t\") pod \"tuned-kz5g2\" (UID: \"577ddb13-6c27-4629-88a2-e8c1cb011435\") " pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:14:59.942872 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.942838    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw4g2\" (UniqueName: \"kubernetes.io/projected/f63370ee-d317-4d56-ac8e-8df54e89dd86-kube-api-access-lw4g2\") pod \"node-ca-znkxk\" (UID: \"f63370ee-d317-4d56-ac8e-8df54e89dd86\") " pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:14:59.943467 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.943418    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htxbb\" (UniqueName: \"kubernetes.io/projected/ec4a75ec-0842-4829-be3c-89e3efd08144-kube-api-access-htxbb\") pod \"node-resolver-dmrjt\" (UID: \"ec4a75ec-0842-4829-be3c-89e3efd08144\") " pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:14:59.943467 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.943455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7bkc\" (UniqueName: \"kubernetes.io/projected/bf96da50-055a-499c-82b8-9b394b9dcd3c-kube-api-access-s7bkc\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:14:59.943779 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:59.943749    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d14cc84bd98b880505d2dcf2acf4e0.slice/crio-83a21e0efc612a96b4d79091b85bcee2c7faf157748032fbd51b485d84045c4a WatchSource:0}: Error finding container 83a21e0efc612a96b4d79091b85bcee2c7faf157748032fbd51b485d84045c4a: Status 404 returned error can't find the container with id 83a21e0efc612a96b4d79091b85bcee2c7faf157748032fbd51b485d84045c4a
Jul 06 14:14:59.943941 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.943916    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htqd9\" (UniqueName: \"kubernetes.io/projected/faccf60e-998c-4f50-9a38-3de692c2dec1-kube-api-access-htqd9\") pod \"multus-hpk5l\" (UID: \"faccf60e-998c-4f50-9a38-3de692c2dec1\") " pod="openshift-multus/multus-hpk5l"
Jul 06 14:14:59.944050 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:14:59.943956    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb495462a2361679d3c36d9506f0a53c2.slice/crio-436b3ab6688b9ff87be1939c13f9ce0ae8e7d5aa681396de86aeb9aa197b05aa WatchSource:0}: Error finding container 436b3ab6688b9ff87be1939c13f9ce0ae8e7d5aa681396de86aeb9aa197b05aa: Status 404 returned error can't find the container with id 436b3ab6688b9ff87be1939c13f9ce0ae8e7d5aa681396de86aeb9aa197b05aa
Jul 06 14:14:59.944436 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.944417    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57trs\" (UniqueName: \"kubernetes.io/projected/8e59933d-c3b8-4194-8f04-535378325b87-kube-api-access-57trs\") pod \"iptables-alerter-8s5rt\" (UID: \"8e59933d-c3b8-4194-8f04-535378325b87\") " pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:14:59.945604 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.945586    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bkrl\" (UniqueName: \"kubernetes.io/projected/7297a7ce-d194-4340-8fec-f938dac1da86-kube-api-access-8bkrl\") pod \"ovnkube-node-vmsx7\" (UID: \"7297a7ce-d194-4340-8fec-f938dac1da86\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:14:59.948181 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:14:59.948166    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:15:00.066577 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.066507    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-znkxk"
Jul 06 14:15:00.070804 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.070775    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hpk5l"
Jul 06 14:15:00.077267 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.077246    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf63370ee_d317_4d56_ac8e_8df54e89dd86.slice/crio-140a37b57b7dc40398a0053222f399cf0120d0b3f579077f4fc390cd3fddc780 WatchSource:0}: Error finding container 140a37b57b7dc40398a0053222f399cf0120d0b3f579077f4fc390cd3fddc780: Status 404 returned error can't find the container with id 140a37b57b7dc40398a0053222f399cf0120d0b3f579077f4fc390cd3fddc780
Jul 06 14:15:00.079011 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.078994    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaccf60e_998c_4f50_9a38_3de692c2dec1.slice/crio-1a6efdf53f01c668390613559269999207d800163258807cb45565487f61d3ba WatchSource:0}: Error finding container 1a6efdf53f01c668390613559269999207d800163258807cb45565487f61d3ba: Status 404 returned error can't find the container with id 1a6efdf53f01c668390613559269999207d800163258807cb45565487f61d3ba
Jul 06 14:15:00.101159 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.101139    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8s5rt"
Jul 06 14:15:00.123877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.123859    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh"
Jul 06 14:15:00.132379 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.132345    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5edd22db_2cf0_4489_9044_dcde40c1e7fd.slice/crio-9976f4f62081b51efb5b53df161ab63270b99b4967f43a41e989e2d0f25ab91d WatchSource:0}: Error finding container 9976f4f62081b51efb5b53df161ab63270b99b4967f43a41e989e2d0f25ab91d: Status 404 returned error can't find the container with id 9976f4f62081b51efb5b53df161ab63270b99b4967f43a41e989e2d0f25ab91d
Jul 06 14:15:00.137413 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.137346    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kz5g2"
Jul 06 14:15:00.145064 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.145043    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577ddb13_6c27_4629_88a2_e8c1cb011435.slice/crio-fb3006e19a6b5a50f73ba8fcc9519fc647f3ce914d8ad3f92c59d9cd1d6f2aac WatchSource:0}: Error finding container fb3006e19a6b5a50f73ba8fcc9519fc647f3ce914d8ad3f92c59d9cd1d6f2aac: Status 404 returned error can't find the container with id fb3006e19a6b5a50f73ba8fcc9519fc647f3ce914d8ad3f92c59d9cd1d6f2aac
Jul 06 14:15:00.155849 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.155832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dmrjt"
Jul 06 14:15:00.163192 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.163173    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4a75ec_0842_4829_be3c_89e3efd08144.slice/crio-368e2ac5eabe42afe5b8266f45d8d522fb9af71299e3b9dcd76943aa3cdca51d WatchSource:0}: Error finding container 368e2ac5eabe42afe5b8266f45d8d522fb9af71299e3b9dcd76943aa3cdca51d: Status 404 returned error can't find the container with id 368e2ac5eabe42afe5b8266f45d8d522fb9af71299e3b9dcd76943aa3cdca51d
Jul 06 14:15:00.171230 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.171213    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzmtk"
Jul 06 14:15:00.178844 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.178826    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff513b35_d72c_442e_a502_39883daf0636.slice/crio-18eb9bc80e939f6c7649a45d10e36753774f648020b46031267f9d011f213f94 WatchSource:0}: Error finding container 18eb9bc80e939f6c7649a45d10e36753774f648020b46031267f9d011f213f94: Status 404 returned error can't find the container with id 18eb9bc80e939f6c7649a45d10e36753774f648020b46031267f9d011f213f94
Jul 06 14:15:00.187983 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.187966    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:00.191741 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.191724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:15:00.196506 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.196486    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7297a7ce_d194_4340_8fec_f938dac1da86.slice/crio-7d80dddc842478abbeb7671e70ecc0246262ff9ddb3055cc9335119eb3d08e59 WatchSource:0}: Error finding container 7d80dddc842478abbeb7671e70ecc0246262ff9ddb3055cc9335119eb3d08e59: Status 404 returned error can't find the container with id 7d80dddc842478abbeb7671e70ecc0246262ff9ddb3055cc9335119eb3d08e59
Jul 06 14:15:00.201610 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:00.201582    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacdd6b44_230e_43ad_8d67_1d846d9c7c80.slice/crio-d016e5f4c192d57555838beb9cc3e67a2fda799585b244e4cd34438d3888689f WatchSource:0}: Error finding container d016e5f4c192d57555838beb9cc3e67a2fda799585b244e4cd34438d3888689f: Status 404 returned error can't find the container with id d016e5f4c192d57555838beb9cc3e67a2fda799585b244e4cd34438d3888689f
Jul 06 14:15:00.431965 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.431873    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:00.431965 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.431957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:00.432205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.432045    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:00.432205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.432071    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:00.432205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.432118    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:15:01.432097265 +0000 UTC m=+3.999004887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:00.432205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.432138    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:01.432128172 +0000 UTC m=+3.999035776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:00.532609 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.532573    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:00.532782 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.532753    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:15:00.532782 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.532775    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:15:00.532863 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.532787    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:00.532863 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.532851    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:15:01.532832151 +0000 UTC m=+4.099739764 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:00.788470 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.788413    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:09:59 +0000 UTC" deadline="2027-12-16 06:21:03.423443948 +0000 UTC"
Jul 06 14:15:00.788470 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.788468    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12664h6m2.634980347s"
Jul 06 14:15:00.849836 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.847049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:00.849836 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:00.847179    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:00.854898 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.854837    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hpk5l" event={"ID":"faccf60e-998c-4f50-9a38-3de692c2dec1","Type":"ContainerStarted","Data":"1a6efdf53f01c668390613559269999207d800163258807cb45565487f61d3ba"}
Jul 06 14:15:00.858767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.858740    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal" event={"ID":"b495462a2361679d3c36d9506f0a53c2","Type":"ContainerStarted","Data":"436b3ab6688b9ff87be1939c13f9ce0ae8e7d5aa681396de86aeb9aa197b05aa"}
Jul 06 14:15:00.864096 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.864070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"7d80dddc842478abbeb7671e70ecc0246262ff9ddb3055cc9335119eb3d08e59"}
Jul 06 14:15:00.866407 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.866381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmrjt" event={"ID":"ec4a75ec-0842-4829-be3c-89e3efd08144","Type":"ContainerStarted","Data":"368e2ac5eabe42afe5b8266f45d8d522fb9af71299e3b9dcd76943aa3cdca51d"}
Jul 06 14:15:00.868107 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.868084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kz5g2" event={"ID":"577ddb13-6c27-4629-88a2-e8c1cb011435","Type":"ContainerStarted","Data":"fb3006e19a6b5a50f73ba8fcc9519fc647f3ce914d8ad3f92c59d9cd1d6f2aac"}
Jul 06 14:15:00.870449 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.870421    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh" event={"ID":"5edd22db-2cf0-4489-9044-dcde40c1e7fd","Type":"ContainerStarted","Data":"9976f4f62081b51efb5b53df161ab63270b99b4967f43a41e989e2d0f25ab91d"}
Jul 06 14:15:00.875896 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.875872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8s5rt" event={"ID":"8e59933d-c3b8-4194-8f04-535378325b87","Type":"ContainerStarted","Data":"351c90715d7b0adb669733138080e3a6a439ecf91909a0416d20905523ef2591"}
Jul 06 14:15:00.887070 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.887043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-znkxk" event={"ID":"f63370ee-d317-4d56-ac8e-8df54e89dd86","Type":"ContainerStarted","Data":"140a37b57b7dc40398a0053222f399cf0120d0b3f579077f4fc390cd3fddc780"}
Jul 06 14:15:00.890633 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.890608    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal" event={"ID":"20d14cc84bd98b880505d2dcf2acf4e0","Type":"ContainerStarted","Data":"83a21e0efc612a96b4d79091b85bcee2c7faf157748032fbd51b485d84045c4a"}
Jul 06 14:15:00.904687 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.904655    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z47mb" event={"ID":"acdd6b44-230e-43ad-8d67-1d846d9c7c80","Type":"ContainerStarted","Data":"d016e5f4c192d57555838beb9cc3e67a2fda799585b244e4cd34438d3888689f"}
Jul 06 14:15:00.911035 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.911002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerStarted","Data":"18eb9bc80e939f6c7649a45d10e36753774f648020b46031267f9d011f213f94"}
Jul 06 14:15:00.957968 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:00.957939    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:15:01.439999 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.439962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:01.440179 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.440038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:01.440245 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.440183    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:01.440245 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.440240    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:15:03.440223382 +0000 UTC m=+6.007130986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:01.440673 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.440649    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:01.440798 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.440712    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:03.440694964 +0000 UTC m=+6.007602564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:01.541270 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.541238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:01.541464 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.541437    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:15:01.541464 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.541458    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:15:01.541578 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.541471    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:01.541578 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.541538    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:15:03.541520281 +0000 UTC m=+6.108427896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:01.789085 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.789015    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 14:09:59 +0000 UTC" deadline="2028-02-14 10:11:21.898471952 +0000 UTC"
Jul 06 14:15:01.789085 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.789083    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14107h56m20.109393793s"
Jul 06 14:15:01.845219 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.845181    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:01.845492 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.845315    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:01.845492 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:01.845419    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:01.845615 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:01.845505    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:02.055155 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:02.055076    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:15:02.100478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:02.100227    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 14:15:02.844606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:02.844575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:02.845069 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:02.844709    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:03.458140 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:03.458105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:03.458324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:03.458195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:03.458324 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.458244    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:03.458324 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.458313    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:07.458295406 +0000 UTC m=+10.025203019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:03.458514 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.458329    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:03.458514 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.458404    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:15:07.458383207 +0000 UTC m=+10.025290819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:03.559030 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:03.558992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:03.559205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.559161    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:15:03.559205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.559183    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:15:03.559205 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.559196    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:03.559395 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.559256    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:15:07.559238408 +0000 UTC m=+10.126146024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:03.845052 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:03.845022    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:03.845052 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:03.845052    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:03.845555 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.845155    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:03.845555 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:03.845259    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:04.845412 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:04.845249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:04.845412 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:04.845400    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:05.844970 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:05.844736    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:05.844970 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:05.844960    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:05.845158 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:05.845077    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:05.845512 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:05.845468    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:06.845232 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:06.845184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:06.845424 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:06.845332    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:07.490920 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:07.490883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:07.491397 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:07.490957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:07.491397 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.491002    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:07.491397 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.491070    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:15.491053736 +0000 UTC m=+18.057961338 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:07.491397 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.491071    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:07.491397 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.491124    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:15:15.49110788 +0000 UTC m=+18.058015482 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:07.591398 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:07.591342    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:07.591565 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.591515    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:15:07.591565 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.591539    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:15:07.591565 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.591549    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:07.591691 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.591604    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:15:15.59158814 +0000 UTC m=+18.158495741 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:07.844569 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:07.844536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:07.844759 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.844667    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:07.844759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:07.844691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:07.844877 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:07.844825    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:08.845282 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:08.845248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:08.845752 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:08.845529    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:09.844410 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:09.844324    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:09.844586 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:09.844330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:09.844586 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:09.844482    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:09.844694 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:09.844576    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:10.847683 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:10.847653    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:10.848114 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:10.847811    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:11.844310 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:11.844211    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:11.844310 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:11.844252    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:11.844574 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:11.844344    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:11.844729 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:11.844700    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:12.848205 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:12.848180    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:12.848612 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:12.848284    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:13.844638 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:13.844607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:13.844820 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:13.844641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:13.844820 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:13.844745    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:13.844930 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:13.844882    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:14.844891 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:14.844850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:14.845338 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:14.844994    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:15.551414 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:15.551375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:15.551607 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:15.551476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:15.551607 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.551523    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:15.551607 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.551594    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:15.551607 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.551604    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:31.551583061 +0000 UTC m=+34.118490664 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:15.551801 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.551645    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:15:31.551627648 +0000 UTC m=+34.118535251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:15.652252 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:15.652219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:15.652455 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.652369    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:15:15.652455 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.652391    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:15:15.652455 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.652401    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:15.652601 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.652462    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:15:31.652437383 +0000 UTC m=+34.219344982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:15.844687 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:15.844601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:15.844841 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:15.844601    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:15.844841 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.844719    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:15.844841 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:15.844799    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:16.844289 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:16.844251    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:16.844493 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:16.844399    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:17.844631 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:17.844592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:17.845046 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:17.844730    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:17.845046 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:17.844783    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:17.845046 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:17.844944    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:18.845099 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:18.845049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:18.845593 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:18.845163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:19.844214 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:19.844189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:19.844214 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:19.844211    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:19.844337 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:19.844298    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:19.844455 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:19.844437    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:19.959513 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:19.959488    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal" event={"ID":"b495462a2361679d3c36d9506f0a53c2","Type":"ContainerStarted","Data":"3e165bd0c701322f021dfcd3a57f5ef1dd04723e2584544b481b7e2c00bdec3d"}
Jul 06 14:15:20.844315 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.844118    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:20.844465 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:20.844434    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:20.962732 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.962703    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dmrjt" event={"ID":"ec4a75ec-0842-4829-be3c-89e3efd08144","Type":"ContainerStarted","Data":"1d793343488ad75b2b85ace3cb676e5230006de0f1d90a19455979b13692b1d8"}
Jul 06 14:15:20.964318 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.964159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kz5g2" event={"ID":"577ddb13-6c27-4629-88a2-e8c1cb011435","Type":"ContainerStarted","Data":"5e9b8d08361b934396a9827860dae1de90db91dd1f7f0e2735cfeb2573b8628e"}
Jul 06 14:15:20.965559 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.965539    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh" event={"ID":"5edd22db-2cf0-4489-9044-dcde40c1e7fd","Type":"ContainerStarted","Data":"03188e38478f7edb71519c33b8f87ec4578797c68ef1bf4087b0df5114d9132e"}
Jul 06 14:15:20.966918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.966899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-znkxk" event={"ID":"f63370ee-d317-4d56-ac8e-8df54e89dd86","Type":"ContainerStarted","Data":"c33f790a02607df5696d0ddfb40bbf4fcb1952758aa45e401b88000cd02e971f"}
Jul 06 14:15:20.968276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.968257    2581 generic.go:356] "Generic (PLEG): container finished" podID="20d14cc84bd98b880505d2dcf2acf4e0" containerID="90328bc16c9cb0c1d16f14bc1555a4874bd7712aa30c5f9dfc72ae663004a340" exitCode=0
Jul 06 14:15:20.968364 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.968317    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal" event={"ID":"20d14cc84bd98b880505d2dcf2acf4e0","Type":"ContainerDied","Data":"90328bc16c9cb0c1d16f14bc1555a4874bd7712aa30c5f9dfc72ae663004a340"}
Jul 06 14:15:20.969784 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.969760    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z47mb" event={"ID":"acdd6b44-230e-43ad-8d67-1d846d9c7c80","Type":"ContainerStarted","Data":"c572c6a076b186fa1bafc5fb3d1e9dfa285264965b4dd3bfda2146b04745fda5"}
Jul 06 14:15:20.971168 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.971146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerStarted","Data":"0900d5af9f91ece8d66be087d89b031093c94193a9d147e64de4b1b28dd9b7f5"}
Jul 06 14:15:20.972504 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.972481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hpk5l" event={"ID":"faccf60e-998c-4f50-9a38-3de692c2dec1","Type":"ContainerStarted","Data":"d2296b3e447563cf4c2c134498d64865f81d1a34ff4f394513f43303ed6f0c07"}
Jul 06 14:15:20.975138 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.975116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"1aead38fadd6137f0037309db9903b9e2f42da6377e4e42c801fd453f4b73944"}
Jul 06 14:15:20.975218 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.975192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"ba33db2263fa607b8838d3d5925cf54ffe2c5e2ba03a8ca5478d7aa75c55954d"}
Jul 06 14:15:20.975265 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.975226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"ef79e15e44865185f2be47023acbf65a6f81e35bb822d07d596457b0901648f7"}
Jul 06 14:15:20.975302 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.975266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"9323686f9d17c7f2f2a928fa6d736f2a6c6e80c9ad842149ba7196e7c1185236"}
Jul 06 14:15:20.975302 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.975294    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"12722833f5dd1c39ce423f5477070b209b5b272fd46dd3f6e90a297129fb1d97"}
Jul 06 14:15:20.975406 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.975322    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"caad1108131679f2c2ec96610f136ab706f5094e55eabb8440e51fcfc5bd0b1c"}
Jul 06 14:15:20.997066 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:20.997022    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dmrjt" podStartSLOduration=2.77370257 podStartE2EDuration="21.997009975s" totalImagesPullingTime="19.223307405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:20.996549931 +0000 UTC m=+23.563457553" watchObservedRunningTime="2026-07-06 14:15:20.997009975 +0000 UTC m=+23.563917596"
Jul 06 14:15:21.069089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.069039    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-znkxk" podStartSLOduration=3.415060041 podStartE2EDuration="23.069018271s" totalImagesPullingTime="19.65395823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:21.04980753 +0000 UTC m=+23.616715151" watchObservedRunningTime="2026-07-06 14:15:21.069018271 +0000 UTC m=+23.635925901"
Jul 06 14:15:21.084576 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.084477    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z47mb" podStartSLOduration=2.554963901 podStartE2EDuration="22.084463031s" totalImagesPullingTime="19.52949913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:21.084140327 +0000 UTC m=+23.651047948" watchObservedRunningTime="2026-07-06 14:15:21.084463031 +0000 UTC m=+23.651370651"
Jul 06 14:15:21.126386 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.126329    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-175.ec2.internal" podStartSLOduration=22.126315426 podStartE2EDuration="22.126315426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:21.126172934 +0000 UTC m=+23.693080546" watchObservedRunningTime="2026-07-06 14:15:21.126315426 +0000 UTC m=+23.693223047"
Jul 06 14:15:21.197250 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.197201    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kz5g2" podStartSLOduration=2.609749131 podStartE2EDuration="22.197188154s" totalImagesPullingTime="19.587439023s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:21.196042239 +0000 UTC m=+23.762949860" watchObservedRunningTime="2026-07-06 14:15:21.197188154 +0000 UTC m=+23.764095776"
Jul 06 14:15:21.197447 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.197428    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hpk5l" podStartSLOduration=3.532912749 podStartE2EDuration="23.197422743s" totalImagesPullingTime="19.664509994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:21.163481851 +0000 UTC m=+23.730389472" watchObservedRunningTime="2026-07-06 14:15:21.197422743 +0000 UTC m=+23.764330374"
Jul 06 14:15:21.844276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.844240    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:21.844537 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:21.844396    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:21.844537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.844430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:21.844664 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:21.844535    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:21.979184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.979146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8s5rt" event={"ID":"8e59933d-c3b8-4194-8f04-535378325b87","Type":"ContainerStarted","Data":"485c81194d1fe794f169be3a5982e04986516b450bd61cff2ac43b88c80c587a"}
Jul 06 14:15:21.981087 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.981058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal" event={"ID":"20d14cc84bd98b880505d2dcf2acf4e0","Type":"ContainerStarted","Data":"574f61994980b17f3785080efbfa6d224cbeb87ad390012c9633a5d1882cdf3d"}
Jul 06 14:15:21.982657 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.982635    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff513b35-d72c-442e-a502-39883daf0636" containerID="0900d5af9f91ece8d66be087d89b031093c94193a9d147e64de4b1b28dd9b7f5" exitCode=0
Jul 06 14:15:21.982788 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:21.982731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerDied","Data":"0900d5af9f91ece8d66be087d89b031093c94193a9d147e64de4b1b28dd9b7f5"}
Jul 06 14:15:22.003539 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.003487    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8s5rt" podStartSLOduration=9.092049588 podStartE2EDuration="24.003469497s" totalImagesPullingTime="14.911419909s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:22.003106796 +0000 UTC m=+24.570014418" watchObservedRunningTime="2026-07-06 14:15:22.003469497 +0000 UTC m=+24.570377122"
Jul 06 14:15:22.246502 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.246473    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 14:15:22.798934 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.798818    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T14:15:22.246491008Z","UUID":"cf9ea543-0f48-4ea1-8734-b24d92702127","Handler":null,"Name":"","Endpoint":""}
Jul 06 14:15:22.800380 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.800343    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 14:15:22.800509 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.800394    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 14:15:22.844735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.844712    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:22.844868 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:22.844840    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:22.986545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.986506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh" event={"ID":"5edd22db-2cf0-4489-9044-dcde40c1e7fd","Type":"ContainerStarted","Data":"56b98501f481a2bd62d2dbda44bf8f99908a842cd403bf94dc2319800e2f35f1"}
Jul 06 14:15:22.990030 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:22.989997    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"f510a32fe8ebb5d793c9fb255fc365b4d97533c30febc06615b46061ec0033da"}
Jul 06 14:15:23.473335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.473247    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:15:23.473946 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.473913    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:15:23.504198 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.504145    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-175.ec2.internal" podStartSLOduration=24.50412756 podStartE2EDuration="24.50412756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:22.068447576 +0000 UTC m=+24.635355219" watchObservedRunningTime="2026-07-06 14:15:23.50412756 +0000 UTC m=+26.071035181"
Jul 06 14:15:23.844485 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.844451    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:23.844655 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:23.844556    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:23.844655 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.844621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:23.844764 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:23.844686    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:23.994887 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.994852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh" event={"ID":"5edd22db-2cf0-4489-9044-dcde40c1e7fd","Type":"ContainerStarted","Data":"902545dbb0913735e39bcfde17a509ff151b37390106519904ec085b7bb5e7ba"}
Jul 06 14:15:23.995341 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.995075    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:15:23.995616 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:23.995597    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z47mb"
Jul 06 14:15:24.026701 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:24.026659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-nmmbh" podStartSLOduration=8.012352182 podStartE2EDuration="25.026646829s" totalImagesPullingTime="17.014294647s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:24.026630629 +0000 UTC m=+26.593538250" watchObservedRunningTime="2026-07-06 14:15:24.026646829 +0000 UTC m=+26.593554449"
Jul 06 14:15:24.844278 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:24.844239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:24.844480 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:24.844366    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:25.844734 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:25.844536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:25.845225 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:25.844584    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:25.845225 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:25.844849    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:25.845225 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:25.844881    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:26.003316 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:26.003278    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" event={"ID":"7297a7ce-d194-4340-8fec-f938dac1da86","Type":"ContainerStarted","Data":"d81ac1c91d7fae737a8cdee3ee19b080915e0a2a4c021c142c389d78738694ab"}
Jul 06 14:15:26.844943 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:26.844915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:26.845388 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:26.845016    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:27.005777 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.005738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:27.005927 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.005826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:27.005927 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.005871    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:27.025245 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.024741    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:27.025245 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.025156    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:27.103979 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.103884    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7" podStartSLOduration=8.210294161 podStartE2EDuration="28.10386672s" totalImagesPullingTime="19.893572559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:26.051752249 +0000 UTC m=+28.618659870" watchObservedRunningTime="2026-07-06 14:15:27.10386672 +0000 UTC m=+29.670774342"
Jul 06 14:15:27.477586 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.477378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xdc2z"]
Jul 06 14:15:27.477714 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.477631    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:27.477769 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:27.477746    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:27.489272 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.489234    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z2h7k"]
Jul 06 14:15:27.489486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.489470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:27.489615 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:27.489594    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:27.489885 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.489866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwxrg"]
Jul 06 14:15:27.489980 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:27.489967    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:27.490083 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:27.490066    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:28.009369 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:28.009325    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff513b35-d72c-442e-a502-39883daf0636" containerID="a6262d4df3125eb4a5ee9b467389880b8eb9cf8bcae52e67c9d5c25a6d690a75" exitCode=0
Jul 06 14:15:28.009819 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:28.009385    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerDied","Data":"a6262d4df3125eb4a5ee9b467389880b8eb9cf8bcae52e67c9d5c25a6d690a75"}
Jul 06 14:15:28.846265 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:28.846230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:28.846476 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:28.846322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:28.846476 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:28.846367    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:28.846476 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:28.846382    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:28.846476 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:28.846464    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:28.846620 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:28.846552    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:30.015916 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:30.015888    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff513b35-d72c-442e-a502-39883daf0636" containerID="69bc78ccaadb1b22f2aed637675c730d7dcb2ecccad3f4978ce5f06ad75586df" exitCode=0
Jul 06 14:15:30.016317 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:30.015949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerDied","Data":"69bc78ccaadb1b22f2aed637675c730d7dcb2ecccad3f4978ce5f06ad75586df"}
Jul 06 14:15:30.844699 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:30.844667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:30.844831 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:30.844667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:30.844888 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:30.844828    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:30.844888 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:30.844667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:30.845003 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:30.844913    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:30.845003 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:30.844948    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:31.020233 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:31.020199    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff513b35-d72c-442e-a502-39883daf0636" containerID="563cf4799b841497861bc794022ec852faabad74e3fad87d665d579e04c02ddb" exitCode=0
Jul 06 14:15:31.020619 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:31.020264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerDied","Data":"563cf4799b841497861bc794022ec852faabad74e3fad87d665d579e04c02ddb"}
Jul 06 14:15:31.573594 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:31.573553    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:31.573777 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:31.573608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:31.573777 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.573693    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:31.573777 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.573695    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:31.573777 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.573746    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:16:03.573731866 +0000 UTC m=+66.140639465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 14:15:31.573777 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.573759    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret podName:161ba2bc-42f7-45ff-b323-199ac408eb75 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:03.573752874 +0000 UTC m=+66.140660473 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret") pod "global-pull-secret-syncer-xdc2z" (UID: "161ba2bc-42f7-45ff-b323-199ac408eb75") : object "kube-system"/"original-pull-secret" not registered
Jul 06 14:15:31.674797 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:31.674767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:31.674940 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.674921    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 14:15:31.674975 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.674944    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 14:15:31.674975 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.674954    2581 projected.go:196] Error preparing data for projected volume kube-api-access-4b5h9 for pod openshift-network-diagnostics/network-check-target-jwxrg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:31.675046 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:31.675001    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9 podName:20d729f5-8bd5-45fe-8040-a17d5adb48ec nodeName:}" failed. No retries permitted until 2026-07-06 14:16:03.674988645 +0000 UTC m=+66.241896249 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4b5h9" (UniqueName: "kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9") pod "network-check-target-jwxrg" (UID: "20d729f5-8bd5-45fe-8040-a17d5adb48ec") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 14:15:32.845182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:32.844974    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:32.845663 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:32.844990    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:32.845663 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:32.845303    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xdc2z" podUID="161ba2bc-42f7-45ff-b323-199ac408eb75"
Jul 06 14:15:32.845663 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:32.845049    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:32.845663 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:32.845396    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2h7k" podUID="bf96da50-055a-499c-82b8-9b394b9dcd3c"
Jul 06 14:15:32.845663 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:32.845462    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jwxrg" podUID="20d729f5-8bd5-45fe-8040-a17d5adb48ec"
Jul 06 14:15:33.744428 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.744303    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-175.ec2.internal" event="NodeReady"
Jul 06 14:15:33.744606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.744486    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 14:15:33.819891 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.819857    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-t5gsc"]
Jul 06 14:15:33.834781 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.834753    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lcmgr"]
Jul 06 14:15:33.834922 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.834876    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:33.839187 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.839164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7sgw\""
Jul 06 14:15:33.839399 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.839170    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 14:15:33.839694 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.839666    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 14:15:33.846139 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.846117    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t5gsc"]
Jul 06 14:15:33.846478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.846215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:33.849510 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.849493    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 14:15:33.849719 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.849704    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 14:15:33.849719 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.849714    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-txr87\""
Jul 06 14:15:33.850313 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.850296    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 14:15:33.855499 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.855469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lcmgr"]
Jul 06 14:15:33.995126 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.995041    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2655c6d-264e-406c-a55d-f7820f1615be-config-volume\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:33.995126 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.995075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dxrf\" (UniqueName: \"kubernetes.io/projected/b2655c6d-264e-406c-a55d-f7820f1615be-kube-api-access-8dxrf\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:33.995126 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.995108    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:33.995386 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.995167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c-cert\") pod \"ingress-canary-lcmgr\" (UID: \"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c\") " pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:33.995386 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.995216    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dlzt\" (UniqueName: \"kubernetes.io/projected/43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c-kube-api-access-2dlzt\") pod \"ingress-canary-lcmgr\" (UID: \"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c\") " pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:33.995386 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:33.995277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2655c6d-264e-406c-a55d-f7820f1615be-tmp-dir\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.096264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c-cert\") pod \"ingress-canary-lcmgr\" (UID: \"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c\") " pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:34.096456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096268    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dlzt\" (UniqueName: \"kubernetes.io/projected/43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c-kube-api-access-2dlzt\") pod \"ingress-canary-lcmgr\" (UID: \"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c\") " pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:34.096456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2655c6d-264e-406c-a55d-f7820f1615be-tmp-dir\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.096456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2655c6d-264e-406c-a55d-f7820f1615be-config-volume\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.096456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096403    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dxrf\" (UniqueName: \"kubernetes.io/projected/b2655c6d-264e-406c-a55d-f7820f1615be-kube-api-access-8dxrf\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.096456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.096690 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:34.096658    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:15:34.096748 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:34.096720    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls podName:b2655c6d-264e-406c-a55d-f7820f1615be nodeName:}" failed. No retries permitted until 2026-07-06 14:15:34.596699937 +0000 UTC m=+37.163607536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls") pod "dns-default-t5gsc" (UID: "b2655c6d-264e-406c-a55d-f7820f1615be") : secret "dns-default-metrics-tls" not found
Jul 06 14:15:34.096748 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.096731    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2655c6d-264e-406c-a55d-f7820f1615be-tmp-dir\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.097050 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.097021    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b2655c6d-264e-406c-a55d-f7820f1615be-config-volume\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.101303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.101277    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c-cert\") pod \"ingress-canary-lcmgr\" (UID: \"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c\") " pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:34.113682 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.113654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dlzt\" (UniqueName: \"kubernetes.io/projected/43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c-kube-api-access-2dlzt\") pod \"ingress-canary-lcmgr\" (UID: \"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c\") " pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:34.114125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.114097    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dxrf\" (UniqueName: \"kubernetes.io/projected/b2655c6d-264e-406c-a55d-f7820f1615be-kube-api-access-8dxrf\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.154238 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.154201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lcmgr"
Jul 06 14:15:34.373375 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.373325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lcmgr"]
Jul 06 14:15:34.378230 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:34.378206    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b7a0bf_4294_4df1_ae93_a51ff6bf7d2c.slice/crio-fdbfde3ce7a6df5cf4308993ba2263939c244d05d817012f34fd8fd8dd8fc341 WatchSource:0}: Error finding container fdbfde3ce7a6df5cf4308993ba2263939c244d05d817012f34fd8fd8dd8fc341: Status 404 returned error can't find the container with id fdbfde3ce7a6df5cf4308993ba2263939c244d05d817012f34fd8fd8dd8fc341
Jul 06 14:15:34.600527 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.600442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:34.600678 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:34.600601    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:15:34.600678 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:34.600670    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls podName:b2655c6d-264e-406c-a55d-f7820f1615be nodeName:}" failed. No retries permitted until 2026-07-06 14:15:35.60065054 +0000 UTC m=+38.167558145 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls") pod "dns-default-t5gsc" (UID: "b2655c6d-264e-406c-a55d-f7820f1615be") : secret "dns-default-metrics-tls" not found
Jul 06 14:15:34.848681 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.848651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:15:34.848681 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.848682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:15:34.849476 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.848652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:15:34.853853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.853788    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:15:34.853853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.853804    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:15:34.857016 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.856994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:15:34.857137 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.856991    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5hdv8\""
Jul 06 14:15:34.857210 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.857143    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mlf5t\""
Jul 06 14:15:34.860833 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:34.860809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:15:35.031286 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:35.031221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lcmgr" event={"ID":"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c","Type":"ContainerStarted","Data":"fdbfde3ce7a6df5cf4308993ba2263939c244d05d817012f34fd8fd8dd8fc341"}
Jul 06 14:15:35.608815 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:35.608777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:35.608980 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:35.608911    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:15:35.608980 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:35.608963    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls podName:b2655c6d-264e-406c-a55d-f7820f1615be nodeName:}" failed. No retries permitted until 2026-07-06 14:15:37.608949971 +0000 UTC m=+40.175857570 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls") pod "dns-default-t5gsc" (UID: "b2655c6d-264e-406c-a55d-f7820f1615be") : secret "dns-default-metrics-tls" not found
Jul 06 14:15:37.626018 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:37.625830    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:37.626496 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:37.626033    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:15:37.626496 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:37.626122    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls podName:b2655c6d-264e-406c-a55d-f7820f1615be nodeName:}" failed. No retries permitted until 2026-07-06 14:15:41.626098709 +0000 UTC m=+44.193006332 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls") pod "dns-default-t5gsc" (UID: "b2655c6d-264e-406c-a55d-f7820f1615be") : secret "dns-default-metrics-tls" not found
Jul 06 14:15:39.042176 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:39.042140    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lcmgr" event={"ID":"43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c","Type":"ContainerStarted","Data":"4d8120085f15b9e424d2093e55bcb5ba7669e2e013f83c4238ee690fe3eddaf5"}
Jul 06 14:15:39.044827 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:39.044804    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff513b35-d72c-442e-a502-39883daf0636" containerID="cd9b9143653e4a89f2f9a825f624a304c086afbfb4cd5a6426a1e0749ec36885" exitCode=0
Jul 06 14:15:39.044935 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:39.044856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerDied","Data":"cd9b9143653e4a89f2f9a825f624a304c086afbfb4cd5a6426a1e0749ec36885"}
Jul 06 14:15:39.063990 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:39.063940    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lcmgr" podStartSLOduration=2.24898747 podStartE2EDuration="6.063922172s" totalImagesPullingTime="3.814934702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:39.062858577 +0000 UTC m=+41.629766199" watchObservedRunningTime="2026-07-06 14:15:39.063922172 +0000 UTC m=+41.630829794"
Jul 06 14:15:40.050176 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:40.050138    2581 generic.go:356] "Generic (PLEG): container finished" podID="ff513b35-d72c-442e-a502-39883daf0636" containerID="18b4142d94edd8d5b4573d8235cd82b77d4e469ddb91725296c4810635224b75" exitCode=0
Jul 06 14:15:40.050579 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:40.050235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerDied","Data":"18b4142d94edd8d5b4573d8235cd82b77d4e469ddb91725296c4810635224b75"}
Jul 06 14:15:41.055536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:41.055496    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" event={"ID":"ff513b35-d72c-442e-a502-39883daf0636","Type":"ContainerStarted","Data":"3c6362ddcbcd781ccda62799d5529f9e69c5a011d9eeaf36661894697d3cd290"}
Jul 06 14:15:41.094292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:41.094241    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mzmtk" podStartSLOduration=8.221090115 podStartE2EDuration="42.094225329s" totalImagesPullingTime="33.873135214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:41.09333137 +0000 UTC m=+43.660238993" watchObservedRunningTime="2026-07-06 14:15:41.094225329 +0000 UTC m=+43.661132944"
Jul 06 14:15:41.655222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:41.655178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:41.655407 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:41.655331    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:15:41.655454 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:41.655407    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls podName:b2655c6d-264e-406c-a55d-f7820f1615be nodeName:}" failed. No retries permitted until 2026-07-06 14:15:49.655390404 +0000 UTC m=+52.222298003 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls") pod "dns-default-t5gsc" (UID: "b2655c6d-264e-406c-a55d-f7820f1615be") : secret "dns-default-metrics-tls" not found
Jul 06 14:15:47.828140 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.828103    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"]
Jul 06 14:15:47.872397 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.872369    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"]
Jul 06 14:15:47.872540 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.872455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"
Jul 06 14:15:47.875135 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.875114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-s9vsz\""
Jul 06 14:15:47.875241 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.875141    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:15:47.876171 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.876156    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 06 14:15:47.955507 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.955471    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"]
Jul 06 14:15:47.976649 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.976620    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"]
Jul 06 14:15:47.976795 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.976776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:47.980064 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.980037    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 14:15:47.980280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.980153    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 14:15:47.980280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.980183    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-2jlnv\""
Jul 06 14:15:47.984008 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.983971    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 14:15:47.984951 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.984933    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:15:47.994916 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.994895    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-v6sbw"]
Jul 06 14:15:47.995024 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.995012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:47.997217 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.997198    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 06 14:15:47.997334 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.997198    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 06 14:15:47.997754 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.997733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9fcbx\""
Jul 06 14:15:47.998326 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.998311    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:15:47.999553 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.999534    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5f7n\" (UniqueName: \"kubernetes.io/projected/a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e-kube-api-access-w5f7n\") pod \"volume-data-source-validator-5d456fdbcd-xqpk2\" (UID: \"a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"
Jul 06 14:15:47.999846 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:47.999828    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 06 14:15:48.011030 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.011010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"]
Jul 06 14:15:48.011144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.011038    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"]
Jul 06 14:15:48.011144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.011054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-v6sbw"]
Jul 06 14:15:48.011144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.011132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.014710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.014691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 06 14:15:48.015009 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.014993    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-srv5p\""
Jul 06 14:15:48.015265 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.015249    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 14:15:48.017539 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.017523    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 06 14:15:48.023147 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.023129    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 14:15:48.024757 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.024739    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 06 14:15:48.065458 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.065430    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b9d666965-mp6f2"]
Jul 06 14:15:48.078048 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.078027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.081606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.081526    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 06 14:15:48.081606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.081542    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 06 14:15:48.081606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.081531    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 06 14:15:48.081855 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.081675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9f5b9\""
Jul 06 14:15:48.081903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.081860    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 06 14:15:48.081903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.081874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 06 14:15:48.082439 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.082424    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 06 14:15:48.100744 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/903754f2-06bf-4900-a1b4-9786df830b18-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.100744 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/903754f2-06bf-4900-a1b4-9786df830b18-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.100944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8h8t\" (UniqueName: \"kubernetes.io/projected/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-kube-api-access-x8h8t\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.100944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5f7n\" (UniqueName: \"kubernetes.io/projected/a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e-kube-api-access-w5f7n\") pod \"volume-data-source-validator-5d456fdbcd-xqpk2\" (UID: \"a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"
Jul 06 14:15:48.100944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vrzh\" (UniqueName: \"kubernetes.io/projected/903754f2-06bf-4900-a1b4-9786df830b18-kube-api-access-2vrzh\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.100944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-config\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.101173 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.100994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.104604 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.104582    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b9d666965-mp6f2"]
Jul 06 14:15:48.112364 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.112327    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5f7n\" (UniqueName: \"kubernetes.io/projected/a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e-kube-api-access-w5f7n\") pod \"volume-data-source-validator-5d456fdbcd-xqpk2\" (UID: \"a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"
Jul 06 14:15:48.181146 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.181093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"
Jul 06 14:15:48.201666 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201640    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-serving-cert\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.201809 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8h8t\" (UniqueName: \"kubernetes.io/projected/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-kube-api-access-x8h8t\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.201809 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.201809 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng59g\" (UniqueName: \"kubernetes.io/projected/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-kube-api-access-ng59g\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.201977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vrzh\" (UniqueName: \"kubernetes.io/projected/903754f2-06bf-4900-a1b4-9786df830b18-kube-api-access-2vrzh\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.201977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201855    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.201977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-config\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.201977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9rvs\" (UniqueName: \"kubernetes.io/projected/a2e91868-666d-47ef-936e-af7cd501f98e-kube-api-access-k9rvs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.201977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.201977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-tmp\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.201994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-snapshots\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-default-certificate\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-stats-auth\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/903754f2-06bf-4900-a1b4-9786df830b18-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/903754f2-06bf-4900-a1b4-9786df830b18-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.202264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.202938 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202908    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-config\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.203085 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.202988    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/903754f2-06bf-4900-a1b4-9786df830b18-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.204473 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.204444    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.204541 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.204486    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/903754f2-06bf-4900-a1b4-9786df830b18-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.215945 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.215906    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vrzh\" (UniqueName: \"kubernetes.io/projected/903754f2-06bf-4900-a1b4-9786df830b18-kube-api-access-2vrzh\") pod \"kube-storage-version-migrator-operator-846bf668f7-8lljn\" (UID: \"903754f2-06bf-4900-a1b4-9786df830b18\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.215945 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.215934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8h8t\" (UniqueName: \"kubernetes.io/projected/f698ccbb-bab7-457b-8ded-6e2b7a565c0b-kube-api-access-x8h8t\") pod \"service-ca-operator-5d46d9ffd4-db85x\" (UID: \"f698ccbb-bab7-457b-8ded-6e2b7a565c0b\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.291372 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.286939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"
Jul 06 14:15:48.302977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.302947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.302977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.302982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng59g\" (UniqueName: \"kubernetes.io/projected/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-kube-api-access-ng59g\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.303184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.303184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9rvs\" (UniqueName: \"kubernetes.io/projected/a2e91868-666d-47ef-936e-af7cd501f98e-kube-api-access-k9rvs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.303184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.303184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-tmp\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.303184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-snapshots\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.303184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-default-certificate\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.303477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-stats-auth\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.303477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.303477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-serving-cert\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.303608 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:48.303538    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:48.803516666 +0000 UTC m=+51.370424279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : configmap references non-existent config key: service-ca.crt
Jul 06 14:15:48.303684 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303655    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.303776 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:48.303745    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:15:48.303776 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.303767    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"
Jul 06 14:15:48.303887 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:48.303827    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:48.803811397 +0000 UTC m=+51.370719004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : secret "router-metrics-certs-default" not found
Jul 06 14:15:48.304029 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.304005    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-tmp\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.304572 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.304533    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-snapshots\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.305103 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.305047    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.306368 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.306325    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-serving-cert\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.306811 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.306794    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-default-certificate\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.307927 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.307905    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-stats-auth\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.336109 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.336048    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9rvs\" (UniqueName: \"kubernetes.io/projected/a2e91868-666d-47ef-936e-af7cd501f98e-kube-api-access-k9rvs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.339903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.339874    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng59g\" (UniqueName: \"kubernetes.io/projected/05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c-kube-api-access-ng59g\") pod \"insights-operator-5c847dcfc4-v6sbw\" (UID: \"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c\") " pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.378900 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.378866    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2"]
Jul 06 14:15:48.383232 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:48.383171    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3bce3a0_ab8a_4d43_98d0_429aa78c9e0e.slice/crio-dfdbbce348d738e5a574f2eba749b97013f1f95a84d523f2f4d6739016e270dd WatchSource:0}: Error finding container dfdbbce348d738e5a574f2eba749b97013f1f95a84d523f2f4d6739016e270dd: Status 404 returned error can't find the container with id dfdbbce348d738e5a574f2eba749b97013f1f95a84d523f2f4d6739016e270dd
Jul 06 14:15:48.463091 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.463041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x"]
Jul 06 14:15:48.474468 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:48.474440    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf698ccbb_bab7_457b_8ded_6e2b7a565c0b.slice/crio-87c25f0e87e7674fe0250d0c683f34b5c0edefd5d9d34d612cd99ba6551d7990 WatchSource:0}: Error finding container 87c25f0e87e7674fe0250d0c683f34b5c0edefd5d9d34d612cd99ba6551d7990: Status 404 returned error can't find the container with id 87c25f0e87e7674fe0250d0c683f34b5c0edefd5d9d34d612cd99ba6551d7990
Jul 06 14:15:48.506481 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.506453    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn"]
Jul 06 14:15:48.509899 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:48.509868    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903754f2_06bf_4900_a1b4_9786df830b18.slice/crio-6d1424d873181779bf05b90be6bbb11e9f57fa6edfbf3873d67ad5ff2ef8f71c WatchSource:0}: Error finding container 6d1424d873181779bf05b90be6bbb11e9f57fa6edfbf3873d67ad5ff2ef8f71c: Status 404 returned error can't find the container with id 6d1424d873181779bf05b90be6bbb11e9f57fa6edfbf3873d67ad5ff2ef8f71c
Jul 06 14:15:48.620830 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.620743    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw"
Jul 06 14:15:48.777879 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.777852    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-v6sbw"]
Jul 06 14:15:48.781138 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:48.781109    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05622d4b_d4fe_41ec_a31e_5e63fd9a4c8c.slice/crio-484e894c195008313ce6c1fb09b81fb9dbd6f7c323a855d4be25348cbfe12418 WatchSource:0}: Error finding container 484e894c195008313ce6c1fb09b81fb9dbd6f7c323a855d4be25348cbfe12418: Status 404 returned error can't find the container with id 484e894c195008313ce6c1fb09b81fb9dbd6f7c323a855d4be25348cbfe12418
Jul 06 14:15:48.807303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.807279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.807459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:48.807322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:48.807522 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:48.807462    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:49.80744478 +0000 UTC m=+52.374352382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : configmap references non-existent config key: service-ca.crt
Jul 06 14:15:48.807522 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:48.807467    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:15:48.807522 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:48.807497    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:49.80749102 +0000 UTC m=+52.374398623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : secret "router-metrics-certs-default" not found
Jul 06 14:15:49.073700 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.073665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn" event={"ID":"903754f2-06bf-4900-a1b4-9786df830b18","Type":"ContainerStarted","Data":"6d1424d873181779bf05b90be6bbb11e9f57fa6edfbf3873d67ad5ff2ef8f71c"}
Jul 06 14:15:49.074610 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.074589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x" event={"ID":"f698ccbb-bab7-457b-8ded-6e2b7a565c0b","Type":"ContainerStarted","Data":"87c25f0e87e7674fe0250d0c683f34b5c0edefd5d9d34d612cd99ba6551d7990"}
Jul 06 14:15:49.075486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.075467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw" event={"ID":"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c","Type":"ContainerStarted","Data":"484e894c195008313ce6c1fb09b81fb9dbd6f7c323a855d4be25348cbfe12418"}
Jul 06 14:15:49.076389 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.076370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2" event={"ID":"a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e","Type":"ContainerStarted","Data":"dfdbbce348d738e5a574f2eba749b97013f1f95a84d523f2f4d6739016e270dd"}
Jul 06 14:15:49.716336 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.716291    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:15:49.716568 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:49.716485    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 14:15:49.716634 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:49.716566    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls podName:b2655c6d-264e-406c-a55d-f7820f1615be nodeName:}" failed. No retries permitted until 2026-07-06 14:16:05.716544418 +0000 UTC m=+68.283452017 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls") pod "dns-default-t5gsc" (UID: "b2655c6d-264e-406c-a55d-f7820f1615be") : secret "dns-default-metrics-tls" not found
Jul 06 14:15:49.817111 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.816841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:49.817111 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:49.816897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:49.817111 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:49.816999    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:51.816976012 +0000 UTC m=+54.383883613 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : configmap references non-existent config key: service-ca.crt
Jul 06 14:15:49.817111 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:49.817028    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:15:49.817111 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:49.817095    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:51.817076013 +0000 UTC m=+54.383983616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : secret "router-metrics-certs-default" not found
Jul 06 14:15:51.831888 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:51.831854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:51.831888 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:51.831896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:51.832346 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:51.831988    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:15:51.832346 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:51.832008    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:55.831990484 +0000 UTC m=+58.398898086 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : configmap references non-existent config key: service-ca.crt
Jul 06 14:15:51.832346 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:51.832032    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:15:55.832021609 +0000 UTC m=+58.398929208 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : secret "router-metrics-certs-default" not found
Jul 06 14:15:52.086653 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:52.086558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn" event={"ID":"903754f2-06bf-4900-a1b4-9786df830b18","Type":"ContainerStarted","Data":"fda2e9fc7f1319a764f1310c7b2c24c950a2b5edad5691242a36d9536c109e76"}
Jul 06 14:15:52.088665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:52.088635    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw" event={"ID":"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c","Type":"ContainerStarted","Data":"30e01091c19221f0eeffbbce56834a97976d2861908520f76395a70e637f345e"}
Jul 06 14:15:52.090497 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:52.090466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2" event={"ID":"a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e","Type":"ContainerStarted","Data":"f0785c2b09efa3eff81334beba82cafba9807378d7994fa0e3854b79fed273a3"}
Jul 06 14:15:52.125490 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:52.125428    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn" podStartSLOduration=1.7803216549999998 podStartE2EDuration="5.125410318s" totalImagesPullingTime="3.345088663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:52.124304745 +0000 UTC m=+54.691212367" watchObservedRunningTime="2026-07-06 14:15:52.125410318 +0000 UTC m=+54.692317975"
Jul 06 14:15:52.194463 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:52.194398    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw" podStartSLOduration=2.118581597 podStartE2EDuration="5.194376843s" totalImagesPullingTime="3.075795246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:52.193108148 +0000 UTC m=+54.760015794" watchObservedRunningTime="2026-07-06 14:15:52.194376843 +0000 UTC m=+54.761284465"
Jul 06 14:15:52.195335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:52.195010    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-xqpk2" podStartSLOduration=1.7284871069999999 podStartE2EDuration="5.194996308s" totalImagesPullingTime="3.466509201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:52.169148981 +0000 UTC m=+54.736056605" watchObservedRunningTime="2026-07-06 14:15:52.194996308 +0000 UTC m=+54.761903930"
Jul 06 14:15:53.757587 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.756794    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t47fq"]
Jul 06 14:15:53.759649 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.759629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.766042 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:53.766004    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"insights-runtime-extractor-t47fq\" is forbidden: User \"system:node:ip-10-0-139-175.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-175.ec2.internal' and this object" podUID="26fee085-30c7-4fcd-8b0f-c9298e083719" pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.766042 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:53.766016    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-139-175.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret"
Jul 06 14:15:53.767060 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:53.766898    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-lm5gg\" is forbidden: User \"system:node:ip-10-0-139-175.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lm5gg\"" type="*v1.Secret"
Jul 06 14:15:53.769594 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:53.769565    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-139-175.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-139-175.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap"
Jul 06 14:15:53.806484 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.806393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t47fq"]
Jul 06 14:15:53.849149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.849107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26fee085-30c7-4fcd-8b0f-c9298e083719-crio-socket\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.849344 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.849162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.849344 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.849224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.849344 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.849267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59brb\" (UniqueName: \"kubernetes.io/projected/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-api-access-59brb\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.849538 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.849452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26fee085-30c7-4fcd-8b0f-c9298e083719-data-volume\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.950494 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.950453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26fee085-30c7-4fcd-8b0f-c9298e083719-crio-socket\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.950494 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.950497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.950727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.950595    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/26fee085-30c7-4fcd-8b0f-c9298e083719-crio-socket\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.950727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.950600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.950727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.950682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59brb\" (UniqueName: \"kubernetes.io/projected/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-api-access-59brb\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.950882 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.950802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26fee085-30c7-4fcd-8b0f-c9298e083719-data-volume\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.951144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.951124    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/26fee085-30c7-4fcd-8b0f-c9298e083719-data-volume\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:53.968224 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:53.968199    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59brb\" (UniqueName: \"kubernetes.io/projected/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-api-access-59brb\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:54.862276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:54.862245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 14:15:54.871554 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:54.871533    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:54.871683 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:54.871595    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:55.371577065 +0000 UTC m=+57.938484663 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:54.946276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:54.946244    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 14:15:54.951362 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:54.951339    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:15:54.951432 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:54.951419    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:55.451399707 +0000 UTC m=+58.018307310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : configmap "kube-rbac-proxy" not found
Jul 06 14:15:55.100241 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.100204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x" event={"ID":"f698ccbb-bab7-457b-8ded-6e2b7a565c0b","Type":"ContainerStarted","Data":"696043bd401bf8a3c6df462d5e0b0a66baa2fcc186ed7c746aab97a6cfdf8dde"}
Jul 06 14:15:55.113578 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.113507    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lm5gg\""
Jul 06 14:15:55.147562 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.147506    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x" podStartSLOduration=2.52422069 podStartE2EDuration="8.147490054s" totalImagesPullingTime="5.623269364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:55.146910715 +0000 UTC m=+57.713818336" watchObservedRunningTime="2026-07-06 14:15:55.147490054 +0000 UTC m=+57.714397675"
Jul 06 14:15:55.462488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.462401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:55.462488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.462448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:55.462743 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.462565    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:55.462743 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.462612    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:15:55.462743 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.462620    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:56.462600827 +0000 UTC m=+59.029508426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:55.462743 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.462671    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:56.462660329 +0000 UTC m=+59.029567928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : configmap "kube-rbac-proxy" not found
Jul 06 14:15:55.592310 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.592283    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmrjt_ec4a75ec-0842-4829-be3c-89e3efd08144/dns-node-resolver/0.log"
Jul 06 14:15:55.866523 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.866488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:55.866523 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:55.866531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:15:55.866998 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.866623    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:15:55.866998 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.866683    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:16:03.866657861 +0000 UTC m=+66.433565476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : configmap references non-existent config key: service-ca.crt
Jul 06 14:15:55.866998 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:55.866714    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:16:03.866705697 +0000 UTC m=+66.433613297 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : secret "router-metrics-certs-default" not found
Jul 06 14:15:56.470746 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:56.470714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:56.470920 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:56.470757    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:56.470920 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:56.470844    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:15:56.470920 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:56.470866    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:56.470920 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:56.470908    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:58.470893032 +0000 UTC m=+61.037800631 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : configmap "kube-rbac-proxy" not found
Jul 06 14:15:56.470920 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:56.470922    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:15:58.470916279 +0000 UTC m=+61.037823877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:56.984661 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:56.984638    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-znkxk_f63370ee-d317-4d56-ac8e-8df54e89dd86/node-ca/0.log"
Jul 06 14:15:57.821811 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:57.821784    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lcmgr_43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c/serve-healthcheck-canary/0.log"
Jul 06 14:15:58.088971 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.088902    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5nbcg"]
Jul 06 14:15:58.117265 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.117228    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5nbcg"]
Jul 06 14:15:58.117431 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.117344    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.121910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.121880    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 06 14:15:58.122149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.122131    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wd88d\""
Jul 06 14:15:58.122668 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.122645    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 06 14:15:58.122786 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.122742    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 06 14:15:58.122848 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.122809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 06 14:15:58.185495 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.185458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-signing-key\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.185495 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.185492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-signing-cabundle\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.185735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.185645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7h2m\" (UniqueName: \"kubernetes.io/projected/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-kube-api-access-w7h2m\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.286423 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.286382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-signing-key\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.286423 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.286422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-signing-cabundle\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.286681 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.286514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7h2m\" (UniqueName: \"kubernetes.io/projected/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-kube-api-access-w7h2m\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.287164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.287132    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-signing-cabundle\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.288908 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.288883    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-signing-key\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.311106 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.311068    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7h2m\" (UniqueName: \"kubernetes.io/projected/f5bfdd2f-4557-4d18-99fe-9dc7f37780b4-kube-api-access-w7h2m\") pod \"service-ca-758f599c5-5nbcg\" (UID: \"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4\") " pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.426308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.426220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-5nbcg"
Jul 06 14:15:58.487863 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.487727    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:58.487863 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.487787    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:15:58.488064 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:58.487964    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:58.488064 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:58.487993    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:15:58.488064 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:58.488030    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:02.488009044 +0000 UTC m=+65.054916658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:15:58.488064 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:15:58.488056    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:02.488043799 +0000 UTC m=+65.054951400 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : configmap "kube-rbac-proxy" not found
Jul 06 14:15:58.586935 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:58.586901    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-5nbcg"]
Jul 06 14:15:58.590513 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:15:58.590485    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bfdd2f_4557_4d18_99fe_9dc7f37780b4.slice/crio-29843fcbd8de50b7c66c5fd6c8ac6e269882a3e02ddd9e04e57d748c5f3d3c31 WatchSource:0}: Error finding container 29843fcbd8de50b7c66c5fd6c8ac6e269882a3e02ddd9e04e57d748c5f3d3c31: Status 404 returned error can't find the container with id 29843fcbd8de50b7c66c5fd6c8ac6e269882a3e02ddd9e04e57d748c5f3d3c31
Jul 06 14:15:59.025137 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:59.025108    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmsx7"
Jul 06 14:15:59.115555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:59.115519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-5nbcg" event={"ID":"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4","Type":"ContainerStarted","Data":"7172554272a60f345f111c020b0a86aaf01ca61b89ded487492b019bedf08e55"}
Jul 06 14:15:59.115940 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:59.115572    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-5nbcg" event={"ID":"f5bfdd2f-4557-4d18-99fe-9dc7f37780b4","Type":"ContainerStarted","Data":"29843fcbd8de50b7c66c5fd6c8ac6e269882a3e02ddd9e04e57d748c5f3d3c31"}
Jul 06 14:15:59.191897 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:15:59.191839    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-5nbcg" podStartSLOduration=1.191823983 podStartE2EDuration="1.191823983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:15:59.188185947 +0000 UTC m=+61.755093567" watchObservedRunningTime="2026-07-06 14:15:59.191823983 +0000 UTC m=+61.758731631"
Jul 06 14:16:02.523154 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:02.523113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:02.523592 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:02.523181    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:02.523592 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:02.523237    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 14:16:02.523592 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:02.523301    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:10.523286257 +0000 UTC m=+73.090193856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : configmap "kube-rbac-proxy" not found
Jul 06 14:16:02.523592 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:02.523304    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:16:02.523592 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:02.523386    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:10.523369651 +0000 UTC m=+73.090277264 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:16:03.632514 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.632476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:16:03.632909 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.632570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:16:03.635624 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.635602    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 14:16:03.636536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.636522    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 14:16:03.642847 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:03.642828    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 06 14:16:03.642927 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:03.642887    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs podName:bf96da50-055a-499c-82b8-9b394b9dcd3c nodeName:}" failed. No retries permitted until 2026-07-06 14:17:07.642867692 +0000 UTC m=+130.209775291 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs") pod "network-metrics-daemon-z2h7k" (UID: "bf96da50-055a-499c-82b8-9b394b9dcd3c") : secret "metrics-daemon-secret" not found
Jul 06 14:16:03.644984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.644958    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/161ba2bc-42f7-45ff-b323-199ac408eb75-original-pull-secret\") pod \"global-pull-secret-syncer-xdc2z\" (UID: \"161ba2bc-42f7-45ff-b323-199ac408eb75\") " pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:16:03.661125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.661103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xdc2z"
Jul 06 14:16:03.733668 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.733640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:16:03.737029 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.736995    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 14:16:03.749300 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.749280    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 14:16:03.756983 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.756956    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b5h9\" (UniqueName: \"kubernetes.io/projected/20d729f5-8bd5-45fe-8040-a17d5adb48ec-kube-api-access-4b5h9\") pod \"network-check-target-jwxrg\" (UID: \"20d729f5-8bd5-45fe-8040-a17d5adb48ec\") " pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:16:03.795842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.795809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xdc2z"]
Jul 06 14:16:03.801630 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:03.801604    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod161ba2bc_42f7_45ff_b323_199ac408eb75.slice/crio-980afb4e5c3ab54f35e69ca344de02487d2aaad69eb5af33ac2e468208bf03ef WatchSource:0}: Error finding container 980afb4e5c3ab54f35e69ca344de02487d2aaad69eb5af33ac2e468208bf03ef: Status 404 returned error can't find the container with id 980afb4e5c3ab54f35e69ca344de02487d2aaad69eb5af33ac2e468208bf03ef
Jul 06 14:16:03.935267 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.935183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:03.935267 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.935226    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:03.935481 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:03.935339    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 06 14:16:03.935481 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:03.935368    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:16:19.93533232 +0000 UTC m=+82.502239924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : configmap references non-existent config key: service-ca.crt
Jul 06 14:16:03.935481 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:03.935408    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs podName:a2e91868-666d-47ef-936e-af7cd501f98e nodeName:}" failed. No retries permitted until 2026-07-06 14:16:19.935392375 +0000 UTC m=+82.502299973 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs") pod "router-default-5b9d666965-mp6f2" (UID: "a2e91868-666d-47ef-936e-af7cd501f98e") : secret "router-metrics-certs-default" not found
Jul 06 14:16:03.969942 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.969912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5hdv8\""
Jul 06 14:16:03.978165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:03.978138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:16:04.109280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:04.109252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jwxrg"]
Jul 06 14:16:04.114923 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:04.114898    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d729f5_8bd5_45fe_8040_a17d5adb48ec.slice/crio-f5866c60307312e10d32c5545cae414f1633736ce4277673ee061efe22c6eb4d WatchSource:0}: Error finding container f5866c60307312e10d32c5545cae414f1633736ce4277673ee061efe22c6eb4d: Status 404 returned error can't find the container with id f5866c60307312e10d32c5545cae414f1633736ce4277673ee061efe22c6eb4d
Jul 06 14:16:04.131467 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:04.131439    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xdc2z" event={"ID":"161ba2bc-42f7-45ff-b323-199ac408eb75","Type":"ContainerStarted","Data":"980afb4e5c3ab54f35e69ca344de02487d2aaad69eb5af33ac2e468208bf03ef"}
Jul 06 14:16:04.132502 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:04.132480    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwxrg" event={"ID":"20d729f5-8bd5-45fe-8040-a17d5adb48ec","Type":"ContainerStarted","Data":"f5866c60307312e10d32c5545cae414f1633736ce4277673ee061efe22c6eb4d"}
Jul 06 14:16:05.752455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:05.752423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:16:05.754874 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:05.754851    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2655c6d-264e-406c-a55d-f7820f1615be-metrics-tls\") pod \"dns-default-t5gsc\" (UID: \"b2655c6d-264e-406c-a55d-f7820f1615be\") " pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:16:05.948743 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:05.948703    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-f7sgw\""
Jul 06 14:16:05.955536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:05.955506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:16:06.150424 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:06.150396    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-t5gsc"]
Jul 06 14:16:06.158399 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:06.158336    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2655c6d_264e_406c_a55d_f7820f1615be.slice/crio-9876f62c2ab65ce65250a6f1137673cbeaa3893b1525cd076b48b463e7ff16ab WatchSource:0}: Error finding container 9876f62c2ab65ce65250a6f1137673cbeaa3893b1525cd076b48b463e7ff16ab: Status 404 returned error can't find the container with id 9876f62c2ab65ce65250a6f1137673cbeaa3893b1525cd076b48b463e7ff16ab
Jul 06 14:16:07.147758 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:07.147702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t5gsc" event={"ID":"b2655c6d-264e-406c-a55d-f7820f1615be","Type":"ContainerStarted","Data":"9876f62c2ab65ce65250a6f1137673cbeaa3893b1525cd076b48b463e7ff16ab"}
Jul 06 14:16:10.602335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:10.602302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:10.602767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:10.602367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:10.602767 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:10.602502    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 14:16:10.602767 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:10.602563    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls podName:26fee085-30c7-4fcd-8b0f-c9298e083719 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:26.60254736 +0000 UTC m=+89.169454958 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t47fq" (UID: "26fee085-30c7-4fcd-8b0f-c9298e083719") : secret "insights-runtime-extractor-tls" not found
Jul 06 14:16:10.602932 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:10.602866    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/26fee085-30c7-4fcd-8b0f-c9298e083719-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:11.163031 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.162993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xdc2z" event={"ID":"161ba2bc-42f7-45ff-b323-199ac408eb75","Type":"ContainerStarted","Data":"c8792fb289e9d832ebc2e1e02de5cb104066919761b19d6689848ff051e33cfb"}
Jul 06 14:16:11.164578 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.164550    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jwxrg" event={"ID":"20d729f5-8bd5-45fe-8040-a17d5adb48ec","Type":"ContainerStarted","Data":"653ed80d19967f8399cb2d9743cfe647fbbae3e6acb2f1b81d282e5b7c11e200"}
Jul 06 14:16:11.164705 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.164607    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:16:11.166142 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.166123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t5gsc" event={"ID":"b2655c6d-264e-406c-a55d-f7820f1615be","Type":"ContainerStarted","Data":"f217fd7e44331e62a4a2a686041551a57ac463ba90eee76d27d1f8d5cf76fbb2"}
Jul 06 14:16:11.166252 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.166156    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-t5gsc" event={"ID":"b2655c6d-264e-406c-a55d-f7820f1615be","Type":"ContainerStarted","Data":"97d19a7d75553a17b04e682b82ac0c3f6da6f14905a8c094599be077f16861d0"}
Jul 06 14:16:11.166252 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.166178    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:16:11.187367 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.187313    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xdc2z" podStartSLOduration=65.691034039 podStartE2EDuration="1m12.187300014s" totalImagesPullingTime="6.496265975s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:11.18724403 +0000 UTC m=+73.754151651" watchObservedRunningTime="2026-07-06 14:16:11.187300014 +0000 UTC m=+73.754207635"
Jul 06 14:16:11.217289 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:11.217231    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jwxrg" podStartSLOduration=66.034593727 podStartE2EDuration="1m12.217215086s" totalImagesPullingTime="6.182621359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:11.216936959 +0000 UTC m=+73.783844580" watchObservedRunningTime="2026-07-06 14:16:11.217215086 +0000 UTC m=+73.784122707"
Jul 06 14:16:19.982511 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:19.982388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:19.982511 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:19.982440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:19.983103 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:19.983080    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2e91868-666d-47ef-936e-af7cd501f98e-service-ca-bundle\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:19.984861 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:19.984829    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2e91868-666d-47ef-936e-af7cd501f98e-metrics-certs\") pod \"router-default-5b9d666965-mp6f2\" (UID: \"a2e91868-666d-47ef-936e-af7cd501f98e\") " pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:20.188398 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:20.188346    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9f5b9\""
Jul 06 14:16:20.195852 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:20.195815    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:20.325242 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:20.325190    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-t5gsc" podStartSLOduration=43.181080813 podStartE2EDuration="47.325170153s" totalImagesPullingTime="4.14408934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:11.25226919 +0000 UTC m=+73.819177003" watchObservedRunningTime="2026-07-06 14:16:20.325170153 +0000 UTC m=+82.892077776"
Jul 06 14:16:20.326428 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:20.326401    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b9d666965-mp6f2"]
Jul 06 14:16:20.329388 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:20.329340    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2e91868_666d_47ef_936e_af7cd501f98e.slice/crio-acbfa9b01f642da7fe1f5aca20db062d21094c6534812f086c6ac8012b97d099 WatchSource:0}: Error finding container acbfa9b01f642da7fe1f5aca20db062d21094c6534812f086c6ac8012b97d099: Status 404 returned error can't find the container with id acbfa9b01f642da7fe1f5aca20db062d21094c6534812f086c6ac8012b97d099
Jul 06 14:16:21.172230 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.172196    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-t5gsc"
Jul 06 14:16:21.201056 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.201024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b9d666965-mp6f2" event={"ID":"a2e91868-666d-47ef-936e-af7cd501f98e","Type":"ContainerStarted","Data":"3f47d233eaf3f98b6cb6f03de5218d8ad167614804a31ea24ebaa413f91d0e44"}
Jul 06 14:16:21.201229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.201076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b9d666965-mp6f2" event={"ID":"a2e91868-666d-47ef-936e-af7cd501f98e","Type":"ContainerStarted","Data":"acbfa9b01f642da7fe1f5aca20db062d21094c6534812f086c6ac8012b97d099"}
Jul 06 14:16:21.230240 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.230194    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b9d666965-mp6f2" podStartSLOduration=33.230179155 podStartE2EDuration="33.230179155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:15:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:21.229500725 +0000 UTC m=+83.796408345" watchObservedRunningTime="2026-07-06 14:16:21.230179155 +0000 UTC m=+83.797086777"
Jul 06 14:16:21.785239 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.785201    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"]
Jul 06 14:16:21.788061 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.788037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:21.791123 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.791097    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 06 14:16:21.792795 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.792757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 06 14:16:21.792964 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.792953    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 06 14:16:21.793698 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.793675    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 06 14:16:21.796686 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.796668    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-km7cr\""
Jul 06 14:16:21.814400 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.814345    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"]
Jul 06 14:16:21.898028 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.897991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fsh5\" (UniqueName: \"kubernetes.io/projected/89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82-kube-api-access-2fsh5\") pod \"managed-serviceaccount-addon-agent-54b7674d4d-c2c6v\" (UID: \"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:21.898217 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.898033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b7674d4d-c2c6v\" (UID: \"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:21.999252 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.999218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fsh5\" (UniqueName: \"kubernetes.io/projected/89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82-kube-api-access-2fsh5\") pod \"managed-serviceaccount-addon-agent-54b7674d4d-c2c6v\" (UID: \"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:21.999252 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:21.999258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b7674d4d-c2c6v\" (UID: \"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:22.001746 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.001719    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54b7674d4d-c2c6v\" (UID: \"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:22.013114 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.013090    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fsh5\" (UniqueName: \"kubernetes.io/projected/89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82-kube-api-access-2fsh5\") pod \"managed-serviceaccount-addon-agent-54b7674d4d-c2c6v\" (UID: \"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:22.105810 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.105727    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"
Jul 06 14:16:22.196736 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.196705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:22.199254 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.199230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:22.205851 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.205826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:22.206976 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.206959    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b9d666965-mp6f2"
Jul 06 14:16:22.243537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.243511    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v"]
Jul 06 14:16:22.246740 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:22.246718    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89f6d826_a9f4_4eaa_ae34_eb0fa8d4dd82.slice/crio-f1ac327f9b0ed599613a2dcce6bf17e264241d1ba75fc6bc861f6cef81063074 WatchSource:0}: Error finding container f1ac327f9b0ed599613a2dcce6bf17e264241d1ba75fc6bc861f6cef81063074: Status 404 returned error can't find the container with id f1ac327f9b0ed599613a2dcce6bf17e264241d1ba75fc6bc861f6cef81063074
Jul 06 14:16:22.564044 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.564013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"]
Jul 06 14:16:22.566626 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.566610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:22.568713 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.568691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6wxdw\""
Jul 06 14:16:22.568843 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.568698    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 14:16:22.579453 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.579429    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"]
Jul 06 14:16:22.705627 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.705591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092f5bd3-e60d-4605-b1f0-9dca7fd628c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lvh2b\" (UID: \"092f5bd3-e60d-4605-b1f0-9dca7fd628c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:22.806903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:22.806861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092f5bd3-e60d-4605-b1f0-9dca7fd628c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lvh2b\" (UID: \"092f5bd3-e60d-4605-b1f0-9dca7fd628c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:22.807067 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:22.807017    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 14:16:22.807114 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:22.807088    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/092f5bd3-e60d-4605-b1f0-9dca7fd628c7-tls-certificates podName:092f5bd3-e60d-4605-b1f0-9dca7fd628c7 nodeName:}" failed. No retries permitted until 2026-07-06 14:16:23.307067486 +0000 UTC m=+85.873975085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/092f5bd3-e60d-4605-b1f0-9dca7fd628c7-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-lvh2b" (UID: "092f5bd3-e60d-4605-b1f0-9dca7fd628c7") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 14:16:23.210760 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:23.210722    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v" event={"ID":"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82","Type":"ContainerStarted","Data":"f1ac327f9b0ed599613a2dcce6bf17e264241d1ba75fc6bc861f6cef81063074"}
Jul 06 14:16:23.311127 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:23.310616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092f5bd3-e60d-4605-b1f0-9dca7fd628c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lvh2b\" (UID: \"092f5bd3-e60d-4605-b1f0-9dca7fd628c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:23.313839 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:23.313793    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/092f5bd3-e60d-4605-b1f0-9dca7fd628c7-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lvh2b\" (UID: \"092f5bd3-e60d-4605-b1f0-9dca7fd628c7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:23.475235 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:23.475134    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:23.634044 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:23.634006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"]
Jul 06 14:16:23.637644 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:23.637612    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092f5bd3_e60d_4605_b1f0_9dca7fd628c7.slice/crio-d32e3cdc766bdb116ec3404fb12ef01c067fa1ea3c67bed3296106327d20b005 WatchSource:0}: Error finding container d32e3cdc766bdb116ec3404fb12ef01c067fa1ea3c67bed3296106327d20b005: Status 404 returned error can't find the container with id d32e3cdc766bdb116ec3404fb12ef01c067fa1ea3c67bed3296106327d20b005
Jul 06 14:16:24.215844 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:24.215808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b" event={"ID":"092f5bd3-e60d-4605-b1f0-9dca7fd628c7","Type":"ContainerStarted","Data":"d32e3cdc766bdb116ec3404fb12ef01c067fa1ea3c67bed3296106327d20b005"}
Jul 06 14:16:26.224125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.224031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v" event={"ID":"89f6d826-a9f4-4eaa-ae34-eb0fa8d4dd82","Type":"ContainerStarted","Data":"876b8b23a7541243ac5b52e3785696b78b836bfc4a2e7707adf48ec6284baecf"}
Jul 06 14:16:26.225632 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.225605    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b" event={"ID":"092f5bd3-e60d-4605-b1f0-9dca7fd628c7","Type":"ContainerStarted","Data":"f2c9a5673a998bd72e451b674f2d4e9d644373fdfcebc23e383aa411fb874c32"}
Jul 06 14:16:26.225745 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.225679    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:26.230243 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.230213    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b"
Jul 06 14:16:26.248032 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.247987    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54b7674d4d-c2c6v" podStartSLOduration=2.07007061 podStartE2EDuration="5.247972909s" totalImagesPullingTime="3.177902299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:26.247410909 +0000 UTC m=+88.814318531" watchObservedRunningTime="2026-07-06 14:16:26.247972909 +0000 UTC m=+88.814880557"
Jul 06 14:16:26.271672 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.271630    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lvh2b" podStartSLOduration=1.991284644 podStartE2EDuration="4.271614596s" totalImagesPullingTime="2.280329952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:26.271398635 +0000 UTC m=+88.838306285" watchObservedRunningTime="2026-07-06 14:16:26.271614596 +0000 UTC m=+88.838522218"
Jul 06 14:16:26.643171 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.643131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:26.645448 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.645418    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/26fee085-30c7-4fcd-8b0f-c9298e083719-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t47fq\" (UID: \"26fee085-30c7-4fcd-8b0f-c9298e083719\") " pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:26.772550 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.772520    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lm5gg\""
Jul 06 14:16:26.780577 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.780549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t47fq"
Jul 06 14:16:26.913646 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:26.913565    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t47fq"]
Jul 06 14:16:26.916448 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:26.916414    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fee085_30c7_4fcd_8b0f_c9298e083719.slice/crio-19554bd950c83256fa2101b4246457dc0818ac58a1fddc9211a923513daa1bae WatchSource:0}: Error finding container 19554bd950c83256fa2101b4246457dc0818ac58a1fddc9211a923513daa1bae: Status 404 returned error can't find the container with id 19554bd950c83256fa2101b4246457dc0818ac58a1fddc9211a923513daa1bae
Jul 06 14:16:27.233141 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:27.233007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t47fq" event={"ID":"26fee085-30c7-4fcd-8b0f-c9298e083719","Type":"ContainerStarted","Data":"19554bd950c83256fa2101b4246457dc0818ac58a1fddc9211a923513daa1bae"}
Jul 06 14:16:32.253461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:32.253430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t47fq" event={"ID":"26fee085-30c7-4fcd-8b0f-c9298e083719","Type":"ContainerStarted","Data":"0dece03442c0b97d136cc8a084050830d84f046d623baf02d578ae3364936303"}
Jul 06 14:16:33.197573 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.197541    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"]
Jul 06 14:16:33.201093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.201068    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.205534 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.205449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 14:16:33.205534 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.205517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 14:16:33.205819 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.205769    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 14:16:33.206051 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.206023    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7mb5q\""
Jul 06 14:16:33.206219 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.206201    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 14:16:33.207016 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.206994    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 14:16:33.219858 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.219839    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"]
Jul 06 14:16:33.223081 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.223062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.230306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.230285    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-2bk52\""
Jul 06 14:16:33.230635 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.230592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 06 14:16:33.230825 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.230807    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 06 14:16:33.234309 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.234142    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 06 14:16:33.246051 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.245981    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"]
Jul 06 14:16:33.255012 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.254987    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"]
Jul 06 14:16:33.274719 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.274685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t47fq" event={"ID":"26fee085-30c7-4fcd-8b0f-c9298e083719","Type":"ContainerStarted","Data":"d5ceb349337feb628d6053f8859b2bcc262a77a5eb8c524b3fea99f3cce06445"}
Jul 06 14:16:33.298619 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.298581    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.298767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.298649    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkt7m\" (UniqueName: \"kubernetes.io/projected/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-kube-api-access-lkt7m\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.298767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.298679    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.298767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.298714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.349428 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.349384    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-97226"]
Jul 06 14:16:33.353368 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.353269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.358164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.358127    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 14:16:33.358701 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.358498    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hhpsl\""
Jul 06 14:16:33.359123 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.359091    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 14:16:33.359653 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.359635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 14:16:33.399717 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkt7m\" (UniqueName: \"kubernetes.io/projected/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-kube-api-access-lkt7m\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.399910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.399910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.399910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.399910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c013881c-8444-4493-b6c6-7d7136c45a68-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.399910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.399910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2784k\" (UniqueName: \"kubernetes.io/projected/c013881c-8444-4493-b6c6-7d7136c45a68-kube-api-access-2784k\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.400221 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.400221 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.399975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c013881c-8444-4493-b6c6-7d7136c45a68-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.400221 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.400000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.400851 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.400818    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.403037 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.403002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.403414 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.403393    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.416249 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.416215    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkt7m\" (UniqueName: \"kubernetes.io/projected/5e096ac1-fe34-4ba8-8126-b9b33c95c14d-kube-api-access-lkt7m\") pod \"openshift-state-metrics-54cf96dfcf-frqtj\" (UID: \"5e096ac1-fe34-4ba8-8126-b9b33c95c14d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.500975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.500941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.501165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.500982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c013881c-8444-4493-b6c6-7d7136c45a68-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.501165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvdkg\" (UniqueName: \"kubernetes.io/projected/7e64fe5a-d371-401b-8827-84244c0aed5d-kube-api-access-vvdkg\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501043    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-textfile\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.501165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2784k\" (UniqueName: \"kubernetes.io/projected/c013881c-8444-4493-b6c6-7d7136c45a68-kube-api-access-2784k\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.501526 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501187    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-tls\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501526 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.501526 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c013881c-8444-4493-b6c6-7d7136c45a68-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.501678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-root\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-wtmp\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e64fe5a-d371-401b-8827-84244c0aed5d-metrics-client-ca\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501678 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-sys\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501871 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.501931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.501918    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c013881c-8444-4493-b6c6-7d7136c45a68-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.502080 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.502054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c013881c-8444-4493-b6c6-7d7136c45a68-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.502156 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.502054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.504288 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.504110    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.504288 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.504209    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c013881c-8444-4493-b6c6-7d7136c45a68-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.513023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.512994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"
Jul 06 14:16:33.515570 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.515548    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2784k\" (UniqueName: \"kubernetes.io/projected/c013881c-8444-4493-b6c6-7d7136c45a68-kube-api-access-2784k\") pod \"kube-state-metrics-7c9dbb8b7d-znsxq\" (UID: \"c013881c-8444-4493-b6c6-7d7136c45a68\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.535455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.535393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"
Jul 06 14:16:33.602704 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-root\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.602865 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-wtmp\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.602865 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e64fe5a-d371-401b-8827-84244c0aed5d-metrics-client-ca\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.602865 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-sys\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.602865 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602841    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.603089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvdkg\" (UniqueName: \"kubernetes.io/projected/7e64fe5a-d371-401b-8827-84244c0aed5d-kube-api-access-vvdkg\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.603089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-textfile\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.603089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.602974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.603089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.603003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-tls\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.603311 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:33.603160    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 14:16:33.603311 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:16:33.603224    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-tls podName:7e64fe5a-d371-401b-8827-84244c0aed5d nodeName:}" failed. No retries permitted until 2026-07-06 14:16:34.103204035 +0000 UTC m=+96.670111633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-tls") pod "node-exporter-97226" (UID: "7e64fe5a-d371-401b-8827-84244c0aed5d") : secret "node-exporter-tls" not found
Jul 06 14:16:33.603695 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.603563    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-root\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.605969 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.604859    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e64fe5a-d371-401b-8827-84244c0aed5d-metrics-client-ca\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.605969 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.604931    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-sys\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.605969 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.605159    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-textfile\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.605969 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.605912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-accelerators-collector-config\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.606718 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.606670    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-wtmp\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.608585 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.608541    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.629120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.629088    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvdkg\" (UniqueName: \"kubernetes.io/projected/7e64fe5a-d371-401b-8827-84244c0aed5d-kube-api-access-vvdkg\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:33.728032 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.727944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj"]
Jul 06 14:16:33.730739 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:33.730710    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq"]
Jul 06 14:16:33.736026 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:33.735991    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc013881c_8444_4493_b6c6_7d7136c45a68.slice/crio-370dc36b8fbfdd5638a8d52ed663711f83a34eefc11f5cb65b7e399894381326 WatchSource:0}: Error finding container 370dc36b8fbfdd5638a8d52ed663711f83a34eefc11f5cb65b7e399894381326: Status 404 returned error can't find the container with id 370dc36b8fbfdd5638a8d52ed663711f83a34eefc11f5cb65b7e399894381326
Jul 06 14:16:33.736595 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:33.736564    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e096ac1_fe34_4ba8_8126_b9b33c95c14d.slice/crio-6f262015eeeb986e5acb30def1c1b0615d6748688ff4e66017805501a38acab4 WatchSource:0}: Error finding container 6f262015eeeb986e5acb30def1c1b0615d6748688ff4e66017805501a38acab4: Status 404 returned error can't find the container with id 6f262015eeeb986e5acb30def1c1b0615d6748688ff4e66017805501a38acab4
Jul 06 14:16:34.109337 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.108845    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-tls\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:34.112376 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.112318    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e64fe5a-d371-401b-8827-84244c0aed5d-node-exporter-tls\") pod \"node-exporter-97226\" (UID: \"7e64fe5a-d371-401b-8827-84244c0aed5d\") " pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:34.265117 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.265075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97226"
Jul 06 14:16:34.279959 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:34.279930    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e64fe5a_d371_401b_8827_84244c0aed5d.slice/crio-1b0de2cd5f35a4a6fcb3d4c42faee85b474f9c054812f85fc6f0b072790701da WatchSource:0}: Error finding container 1b0de2cd5f35a4a6fcb3d4c42faee85b474f9c054812f85fc6f0b072790701da: Status 404 returned error can't find the container with id 1b0de2cd5f35a4a6fcb3d4c42faee85b474f9c054812f85fc6f0b072790701da
Jul 06 14:16:34.281850 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.281752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq" event={"ID":"c013881c-8444-4493-b6c6-7d7136c45a68","Type":"ContainerStarted","Data":"370dc36b8fbfdd5638a8d52ed663711f83a34eefc11f5cb65b7e399894381326"}
Jul 06 14:16:34.284268 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.284242    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj" event={"ID":"5e096ac1-fe34-4ba8-8126-b9b33c95c14d","Type":"ContainerStarted","Data":"f2fa37bef6fdd576db26811323593af6e25ae916378a997bdfdc5fcba651b04a"}
Jul 06 14:16:34.284383 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.284303    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj" event={"ID":"5e096ac1-fe34-4ba8-8126-b9b33c95c14d","Type":"ContainerStarted","Data":"7e1b54f0cb40dd32d5a37983c894ccad41a6be679c613a6c1d38b67914ff52aa"}
Jul 06 14:16:34.284383 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.284331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj" event={"ID":"5e096ac1-fe34-4ba8-8126-b9b33c95c14d","Type":"ContainerStarted","Data":"6f262015eeeb986e5acb30def1c1b0615d6748688ff4e66017805501a38acab4"}
Jul 06 14:16:34.310417 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.310386    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:16:34.314327 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.314248    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.317728 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.317703    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 14:16:34.317862 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.317705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 14:16:34.317998 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.317977    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 14:16:34.318109 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.318021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 14:16:34.318341 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.318326    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 14:16:34.318636 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.318617    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 14:16:34.319035 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.319007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5hgn7\""
Jul 06 14:16:34.319267 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.319245    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 14:16:34.319934 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.319915    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 14:16:34.325114 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.325094    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 14:16:34.344005 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.343961    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:16:34.412270 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412270 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412270 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412270 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx982\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-kube-api-access-gx982\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412331    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412426    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-web-config\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412461    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412584    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-config-volume\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412914 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.412914 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.412729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-config-out\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.513773 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.513733    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-config-volume\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.513959 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.513783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514021 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.513956    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-config-out\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514021 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514124 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514124 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514124 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514124 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx982\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-kube-api-access-gx982\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514207    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-web-config\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514522 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514522 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.514957 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.514724    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.515947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.515232    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.515947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.515891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.517757 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.517708    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-web-config\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.517866 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.517842    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.517940 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.517874    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-config-volume\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.518276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.518252    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.518555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.518508    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-config-out\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.518667 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.518638    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.519511 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.519332    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.519511 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.519468    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.520117 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.520096    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.525633 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.525610    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx982\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-kube-api-access-gx982\") pod \"alertmanager-main-0\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:34.625075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:34.625039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:16:35.289340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:35.289281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97226" event={"ID":"7e64fe5a-d371-401b-8827-84244c0aed5d","Type":"ContainerStarted","Data":"1b0de2cd5f35a4a6fcb3d4c42faee85b474f9c054812f85fc6f0b072790701da"}
Jul 06 14:16:35.546652 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:35.546618    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd301595_36e6_4844_8080_ea4350f81541.slice/crio-723f7cdfe962858a06f452a8539ef069bcf289cebccc90aeec4c290d3eae7e50 WatchSource:0}: Error finding container 723f7cdfe962858a06f452a8539ef069bcf289cebccc90aeec4c290d3eae7e50: Status 404 returned error can't find the container with id 723f7cdfe962858a06f452a8539ef069bcf289cebccc90aeec4c290d3eae7e50
Jul 06 14:16:35.554964 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:35.554939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:16:36.297863 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:36.297638    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t47fq" event={"ID":"26fee085-30c7-4fcd-8b0f-c9298e083719","Type":"ContainerStarted","Data":"2d5a24186f28c161fbc5a5207215c7f3edc640e425b76a8623bbb28880933e6e"}
Jul 06 14:16:36.299562 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:36.299500    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97226" event={"ID":"7e64fe5a-d371-401b-8827-84244c0aed5d","Type":"ContainerStarted","Data":"7851b796884f7756c0d39a6e3c390ac1028872b8e39f513887f3cfce701544d2"}
Jul 06 14:16:36.301168 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:36.301137    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"723f7cdfe962858a06f452a8539ef069bcf289cebccc90aeec4c290d3eae7e50"}
Jul 06 14:16:36.374632 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:36.374320    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t47fq" podStartSLOduration=34.953923389 podStartE2EDuration="43.37429839s" totalImagesPullingTime="8.420375001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:15:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:36.330787139 +0000 UTC m=+98.897694789" watchObservedRunningTime="2026-07-06 14:16:36.37429839 +0000 UTC m=+98.941206028"
Jul 06 14:16:37.307842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.307800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj" event={"ID":"5e096ac1-fe34-4ba8-8126-b9b33c95c14d","Type":"ContainerStarted","Data":"c55a559e8e17a9dd20a1729c4a9dbc3f16247198c17603876a4eb48c827765ce"}
Jul 06 14:16:37.309698 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.309670    2581 generic.go:356] "Generic (PLEG): container finished" podID="7e64fe5a-d371-401b-8827-84244c0aed5d" containerID="7851b796884f7756c0d39a6e3c390ac1028872b8e39f513887f3cfce701544d2" exitCode=0
Jul 06 14:16:37.309804 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.309751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97226" event={"ID":"7e64fe5a-d371-401b-8827-84244c0aed5d","Type":"ContainerDied","Data":"7851b796884f7756c0d39a6e3c390ac1028872b8e39f513887f3cfce701544d2"}
Jul 06 14:16:37.311397 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.311375    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a" exitCode=0
Jul 06 14:16:37.311507 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.311448    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"}
Jul 06 14:16:37.313815 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.313793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq" event={"ID":"c013881c-8444-4493-b6c6-7d7136c45a68","Type":"ContainerStarted","Data":"0f9cc7455320d937d563a745ca6a661d15bf3f079f31e7b8de2e5701859a1e57"}
Jul 06 14:16:37.313901 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.313842    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq" event={"ID":"c013881c-8444-4493-b6c6-7d7136c45a68","Type":"ContainerStarted","Data":"286ee444794048eedf2a376d7e78127e3ccc1902b714c021f4e778dc58cbda5e"}
Jul 06 14:16:37.313901 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.313870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq" event={"ID":"c013881c-8444-4493-b6c6-7d7136c45a68","Type":"ContainerStarted","Data":"1c546ad58ff0318dbbfc5f91053ab4f03b82b5755e8c333d7d3063b219469258"}
Jul 06 14:16:37.363820 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.363778    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-frqtj" podStartSLOduration=1.260392276 podStartE2EDuration="4.363757497s" totalImagesPullingTime="3.103365221s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:37.362795138 +0000 UTC m=+99.929702785" watchObservedRunningTime="2026-07-06 14:16:37.363757497 +0000 UTC m=+99.930665118"
Jul 06 14:16:37.493887 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:37.493768    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-znsxq" podStartSLOduration=1.236481912 podStartE2EDuration="4.49374532s" totalImagesPullingTime="3.257263408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:37.490073363 +0000 UTC m=+100.056980985" watchObservedRunningTime="2026-07-06 14:16:37.49374532 +0000 UTC m=+100.060652943"
Jul 06 14:16:38.320415 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:38.320302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97226" event={"ID":"7e64fe5a-d371-401b-8827-84244c0aed5d","Type":"ContainerStarted","Data":"8cf8b415601e6fb2848244b6c0a646a6bb797aa69c3d53ea5c63c66b88249262"}
Jul 06 14:16:38.320800 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:38.320425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97226" event={"ID":"7e64fe5a-d371-401b-8827-84244c0aed5d","Type":"ContainerStarted","Data":"9255a01db367ae5490902f212283b621970ce6b82b8a4b2eb54460f4c0b8cb09"}
Jul 06 14:16:38.364061 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:38.364001    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-97226" podStartSLOduration=3.538727373 podStartE2EDuration="5.363981844s" totalImagesPullingTime="1.750133972s" totalInitContainerRuntime="75.120499ms" isStatefulPod=true podCreationTimestamp="2026-07-06 14:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:38.3621802 +0000 UTC m=+100.929087822" watchObservedRunningTime="2026-07-06 14:16:38.363981844 +0000 UTC m=+100.930889464"
Jul 06 14:16:39.887293 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.887263    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:16:39.890951 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.890930    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.893934 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.893909    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 14:16:39.897876 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897330    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 14:16:39.897876 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897386    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 14:16:39.897876 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897605    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 14:16:39.897876 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897678    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 14:16:39.897876 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897807    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 14:16:39.898164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 14:16:39.898164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897931    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 14:16:39.898164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897962    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 14:16:39.898164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897953    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 14:16:39.898164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.897903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 14:16:39.898164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.898105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 14:16:39.898490 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.898253    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1n1pnajvho8k4\""
Jul 06 14:16:39.898490 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.898472    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 14:16:39.905022 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.904994    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rbtnz\""
Jul 06 14:16:39.906062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.906039    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 14:16:39.912991 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.912967    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 14:16:39.914570 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.914540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:16:39.968106 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968078    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968204 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968204 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968281 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968498 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968498 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwt6j\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-kube-api-access-lwt6j\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968560 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968594 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968563    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968624 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968600    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968646    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968717 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968746 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968746 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968803 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968766    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:39.968803 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:39.968795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070214 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070185    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070302 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070371 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070371 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070441    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070601    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwt6j\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-kube-api-access-lwt6j\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070754    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.070817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.071093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.071093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.071093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070859    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.071093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.070879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.071267 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.071215    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.071267 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.071219    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.072278 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.072015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.072278 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.072212    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.073376 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.073108    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.073376 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.073168    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.075368 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.075309    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.075511 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.075462    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.076191 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076156    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-web-config\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.076265 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076211    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.076940 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076667    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.076940 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076882    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config-out\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.077093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076979    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.077093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076989    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.077093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.076980    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.077093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.077082    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.077298 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.077097    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.078760 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.078741    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.082935 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.082875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwt6j\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-kube-api-access-lwt6j\") pod \"prometheus-k8s-0\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.200417 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.200391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:16:40.332584 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.332553    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"}
Jul 06 14:16:40.332761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.332634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"}
Jul 06 14:16:40.332761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.332672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"}
Jul 06 14:16:40.332761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.332708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"}
Jul 06 14:16:40.332761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.332744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"}
Jul 06 14:16:40.365878 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:40.365855    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:16:40.368384 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:16:40.368344    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a4ecb9_f440_4fa4_8a6c_f1ca992250fd.slice/crio-8839ed116c186ff96f1c04b0c7255b249531e1b33fc8ef44a5e8eef22de3a650 WatchSource:0}: Error finding container 8839ed116c186ff96f1c04b0c7255b249531e1b33fc8ef44a5e8eef22de3a650: Status 404 returned error can't find the container with id 8839ed116c186ff96f1c04b0c7255b249531e1b33fc8ef44a5e8eef22de3a650
Jul 06 14:16:41.340533 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:41.340497    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d" exitCode=0
Jul 06 14:16:41.341000 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:41.340558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"}
Jul 06 14:16:41.341000 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:41.340606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"8839ed116c186ff96f1c04b0c7255b249531e1b33fc8ef44a5e8eef22de3a650"}
Jul 06 14:16:42.172374 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:42.172325    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jwxrg"
Jul 06 14:16:42.349049 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:42.349012    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerStarted","Data":"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"}
Jul 06 14:16:42.380259 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:42.380158    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.455293254 podStartE2EDuration="8.380140697s" totalImagesPullingTime="5.908897746s" totalInitContainerRuntime="15.949697ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:42.378403189 +0000 UTC m=+104.945310833" watchObservedRunningTime="2026-07-06 14:16:42.380140697 +0000 UTC m=+104.947048379"
Jul 06 14:16:46.375222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:46.375182    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"}
Jul 06 14:16:46.375693 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:46.375257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"}
Jul 06 14:16:48.387877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:48.387843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"}
Jul 06 14:16:48.388244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:48.387905    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"}
Jul 06 14:16:48.388244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:48.387934    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"}
Jul 06 14:16:48.388244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:48.387963    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerStarted","Data":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"}
Jul 06 14:16:48.420901 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:48.420847    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.230150219 podStartE2EDuration="9.420830636s" totalImagesPullingTime="6.170779448s" totalInitContainerRuntime="19.900969ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:16:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:16:48.41870525 +0000 UTC m=+110.985612900" watchObservedRunningTime="2026-07-06 14:16:48.420830636 +0000 UTC m=+110.987738257"
Jul 06 14:16:50.200932 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:16:50.200900    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:03.447296 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:03.447263    2581 generic.go:356] "Generic (PLEG): container finished" podID="903754f2-06bf-4900-a1b4-9786df830b18" containerID="fda2e9fc7f1319a764f1310c7b2c24c950a2b5edad5691242a36d9536c109e76" exitCode=0
Jul 06 14:17:03.447713 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:03.447338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn" event={"ID":"903754f2-06bf-4900-a1b4-9786df830b18","Type":"ContainerDied","Data":"fda2e9fc7f1319a764f1310c7b2c24c950a2b5edad5691242a36d9536c109e76"}
Jul 06 14:17:03.447768 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:03.447714    2581 scope.go:117] "RemoveContainer" containerID="fda2e9fc7f1319a764f1310c7b2c24c950a2b5edad5691242a36d9536c109e76"
Jul 06 14:17:04.453324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:04.453286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-8lljn" event={"ID":"903754f2-06bf-4900-a1b4-9786df830b18","Type":"ContainerStarted","Data":"dfd57f6e2b22c8e713531b4ff7a9ac1a82fd5e814da9de3b5a3410ecc5664645"}
Jul 06 14:17:07.721087 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:07.721047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:17:07.723395 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:07.723370    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bf96da50-055a-499c-82b8-9b394b9dcd3c-metrics-certs\") pod \"network-metrics-daemon-z2h7k\" (UID: \"bf96da50-055a-499c-82b8-9b394b9dcd3c\") " pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:17:07.876293 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:07.876220    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mlf5t\""
Jul 06 14:17:07.881472 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:07.881455    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2h7k"
Jul 06 14:17:08.019672 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:08.019638    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z2h7k"]
Jul 06 14:17:08.023312 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:17:08.023286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf96da50_055a_499c_82b8_9b394b9dcd3c.slice/crio-b0830b21cfe748040c3ed3e5da372d0fd3efaf4a529a845e0e4a76e2f4c5dcea WatchSource:0}: Error finding container b0830b21cfe748040c3ed3e5da372d0fd3efaf4a529a845e0e4a76e2f4c5dcea: Status 404 returned error can't find the container with id b0830b21cfe748040c3ed3e5da372d0fd3efaf4a529a845e0e4a76e2f4c5dcea
Jul 06 14:17:08.469873 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:08.469840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2h7k" event={"ID":"bf96da50-055a-499c-82b8-9b394b9dcd3c","Type":"ContainerStarted","Data":"b0830b21cfe748040c3ed3e5da372d0fd3efaf4a529a845e0e4a76e2f4c5dcea"}
Jul 06 14:17:08.471138 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:08.471112    2581 generic.go:356] "Generic (PLEG): container finished" podID="05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c" containerID="30e01091c19221f0eeffbbce56834a97976d2861908520f76395a70e637f345e" exitCode=0
Jul 06 14:17:08.471252 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:08.471160    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw" event={"ID":"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c","Type":"ContainerDied","Data":"30e01091c19221f0eeffbbce56834a97976d2861908520f76395a70e637f345e"}
Jul 06 14:17:08.471495 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:08.471482    2581 scope.go:117] "RemoveContainer" containerID="30e01091c19221f0eeffbbce56834a97976d2861908520f76395a70e637f345e"
Jul 06 14:17:09.477268 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:09.477188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-v6sbw" event={"ID":"05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c","Type":"ContainerStarted","Data":"5672f58dc07cf3754ce6c4a0cc421dd7e722fe02daf9ff7ba579c1e70f495d65"}
Jul 06 14:17:09.479445 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:09.479416    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2h7k" event={"ID":"bf96da50-055a-499c-82b8-9b394b9dcd3c","Type":"ContainerStarted","Data":"ad89d92950870d281977a1dcfe5511bd9cde1f9ff1e76f75c973d06e19b5b5f9"}
Jul 06 14:17:09.479580 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:09.479467    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2h7k" event={"ID":"bf96da50-055a-499c-82b8-9b394b9dcd3c","Type":"ContainerStarted","Data":"0bc00b8084309c7c7a254d0aac12161540a47003e21890da4d0d4b4bf10b0856"}
Jul 06 14:17:09.610734 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:09.610686    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z2h7k" podStartSLOduration=129.505855922 podStartE2EDuration="2m10.610668637s" totalImagesPullingTime="1.104812715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:09.609738163 +0000 UTC m=+132.176645815" watchObservedRunningTime="2026-07-06 14:17:09.610668637 +0000 UTC m=+132.177576257"
Jul 06 14:17:30.571178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:30.571143    2581 generic.go:356] "Generic (PLEG): container finished" podID="f698ccbb-bab7-457b-8ded-6e2b7a565c0b" containerID="696043bd401bf8a3c6df462d5e0b0a66baa2fcc186ed7c746aab97a6cfdf8dde" exitCode=0
Jul 06 14:17:30.571749 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:30.571221    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x" event={"ID":"f698ccbb-bab7-457b-8ded-6e2b7a565c0b","Type":"ContainerDied","Data":"696043bd401bf8a3c6df462d5e0b0a66baa2fcc186ed7c746aab97a6cfdf8dde"}
Jul 06 14:17:30.571749 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:30.571682    2581 scope.go:117] "RemoveContainer" containerID="696043bd401bf8a3c6df462d5e0b0a66baa2fcc186ed7c746aab97a6cfdf8dde"
Jul 06 14:17:31.576442 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:31.576404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-db85x" event={"ID":"f698ccbb-bab7-457b-8ded-6e2b7a565c0b","Type":"ContainerStarted","Data":"af7da43441f0451daf0821006d01303ac2a9316fde37a1aaa171f2984a1f2fa2"}
Jul 06 14:17:40.200806 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:40.200768    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:40.216501 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:40.216474    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:40.624538 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:40.624509    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:54.002229 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.002147    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:17:54.002609 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.002450    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="alertmanager" containerID="cri-o://2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be" gracePeriod=120
Jul 06 14:17:54.002791 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.002771    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="prom-label-proxy" containerID="cri-o://bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709" gracePeriod=120
Jul 06 14:17:54.002873 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.002860    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-metric" containerID="cri-o://7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c" gracePeriod=120
Jul 06 14:17:54.002931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.002920    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy" containerID="cri-o://b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124" gracePeriod=120
Jul 06 14:17:54.002984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.002971    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-web" containerID="cri-o://63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5" gracePeriod=120
Jul 06 14:17:54.003043 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.003032    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="config-reloader" containerID="cri-o://8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4" gracePeriod=120
Jul 06 14:17:54.673120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673083    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709" exitCode=0
Jul 06 14:17:54.673120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673115    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124" exitCode=0
Jul 06 14:17:54.673120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673121    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4" exitCode=0
Jul 06 14:17:54.673120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673127    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be" exitCode=0
Jul 06 14:17:54.673408 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"}
Jul 06 14:17:54.673408 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673249    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"}
Jul 06 14:17:54.673408 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"}
Jul 06 14:17:54.673408 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:54.673302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"}
Jul 06 14:17:55.347835 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.347772    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.447149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447118    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-metrics-client-ca\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447185    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-main-db\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447201    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-config-volume\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447218    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-tls-assets\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-web\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-cluster-tls-config\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-config-out\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-main-tls\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447426    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-metric\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447456    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gx982\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-kube-api-access-gx982\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447499    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-web-config\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447532    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-trusted-ca-bundle\") pod \"cd301595-36e6-4844-8080-ea4350f81541\" (UID: \"cd301595-36e6-4844-8080-ea4350f81541\") "
Jul 06 14:17:55.447588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447565    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:55.447918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447574    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:55.447918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447814    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-metrics-client-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.447918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.447843    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-main-db\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.450022 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.449992    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-config-volume" (OuterVolumeSpecName: "config-volume") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.450569 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.450262    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-config-out" (OuterVolumeSpecName: "config-out") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:55.450569 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.450305    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:55.450786 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.450646    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.450786 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.450668    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.450786 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.450692    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:55.450786 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.450716    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-kube-api-access-gx982" (OuterVolumeSpecName: "kube-api-access-gx982") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "kube-api-access-gx982". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:55.451254 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.451223    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.452024 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.451998    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.455088 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.455067    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.462623 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.462596    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-web-config" (OuterVolumeSpecName: "web-config") pod "cd301595-36e6-4844-8080-ea4350f81541" (UID: "cd301595-36e6-4844-8080-ea4350f81541"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:55.548713 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548668    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd301595-36e6-4844-8080-ea4350f81541-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548713 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548704    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548713 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548714    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-config-volume\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548713 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548724    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-tls-assets\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548733    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548742    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-cluster-tls-config\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548749    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cd301595-36e6-4844-8080-ea4350f81541-config-out\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548758    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-main-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548766    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548775    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gx982\" (UniqueName: \"kubernetes.io/projected/cd301595-36e6-4844-8080-ea4350f81541-kube-api-access-gx982\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.548977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.548784    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cd301595-36e6-4844-8080-ea4350f81541-web-config\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:55.680131 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680048    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c" exitCode=0
Jul 06 14:17:55.680131 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680070    2581 generic.go:356] "Generic (PLEG): container finished" podID="cd301595-36e6-4844-8080-ea4350f81541" containerID="63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5" exitCode=0
Jul 06 14:17:55.680295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680133    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.680295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"}
Jul 06 14:17:55.680295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680219    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"}
Jul 06 14:17:55.680295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680265    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cd301595-36e6-4844-8080-ea4350f81541","Type":"ContainerDied","Data":"723f7cdfe962858a06f452a8539ef069bcf289cebccc90aeec4c290d3eae7e50"}
Jul 06 14:17:55.680295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.680283    2581 scope.go:117] "RemoveContainer" containerID="bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"
Jul 06 14:17:55.688496 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.688473    2581 scope.go:117] "RemoveContainer" containerID="7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"
Jul 06 14:17:55.695892 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.695872    2581 scope.go:117] "RemoveContainer" containerID="b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"
Jul 06 14:17:55.703294 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.703274    2581 scope.go:117] "RemoveContainer" containerID="63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"
Jul 06 14:17:55.711817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.711798    2581 scope.go:117] "RemoveContainer" containerID="8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"
Jul 06 14:17:55.719458 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.719432    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:17:55.719759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.719745    2581 scope.go:117] "RemoveContainer" containerID="2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"
Jul 06 14:17:55.727132 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.727116    2581 scope.go:117] "RemoveContainer" containerID="671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"
Jul 06 14:17:55.733705 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.733685    2581 scope.go:117] "RemoveContainer" containerID="bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"
Jul 06 14:17:55.733937 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.733919    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709\": container with ID starting with bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709 not found: ID does not exist" containerID="bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"
Jul 06 14:17:55.733984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.733945    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"} err="failed to get container status \"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709\": rpc error: code = NotFound desc = could not find container \"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709\": container with ID starting with bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709 not found: ID does not exist"
Jul 06 14:17:55.733984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.733977    2581 scope.go:117] "RemoveContainer" containerID="7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"
Jul 06 14:17:55.734207 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.734188    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c\": container with ID starting with 7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c not found: ID does not exist" containerID="7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"
Jul 06 14:17:55.734268 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734216    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"} err="failed to get container status \"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c\": rpc error: code = NotFound desc = could not find container \"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c\": container with ID starting with 7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c not found: ID does not exist"
Jul 06 14:17:55.734268 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734240    2581 scope.go:117] "RemoveContainer" containerID="b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"
Jul 06 14:17:55.734495 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.734481    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124\": container with ID starting with b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124 not found: ID does not exist" containerID="b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"
Jul 06 14:17:55.734541 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734501    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"} err="failed to get container status \"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124\": rpc error: code = NotFound desc = could not find container \"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124\": container with ID starting with b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124 not found: ID does not exist"
Jul 06 14:17:55.734541 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734517    2581 scope.go:117] "RemoveContainer" containerID="63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"
Jul 06 14:17:55.734739 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.734722    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5\": container with ID starting with 63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5 not found: ID does not exist" containerID="63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"
Jul 06 14:17:55.734779 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734743    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"} err="failed to get container status \"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5\": rpc error: code = NotFound desc = could not find container \"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5\": container with ID starting with 63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5 not found: ID does not exist"
Jul 06 14:17:55.734779 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734757    2581 scope.go:117] "RemoveContainer" containerID="8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"
Jul 06 14:17:55.734978 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.734962    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4\": container with ID starting with 8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4 not found: ID does not exist" containerID="8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"
Jul 06 14:17:55.735040 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.734986    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"} err="failed to get container status \"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4\": rpc error: code = NotFound desc = could not find container \"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4\": container with ID starting with 8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4 not found: ID does not exist"
Jul 06 14:17:55.735040 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735006    2581 scope.go:117] "RemoveContainer" containerID="2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"
Jul 06 14:17:55.735226 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.735210    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be\": container with ID starting with 2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be not found: ID does not exist" containerID="2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"
Jul 06 14:17:55.735263 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735229    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"} err="failed to get container status \"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be\": rpc error: code = NotFound desc = could not find container \"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be\": container with ID starting with 2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be not found: ID does not exist"
Jul 06 14:17:55.735263 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735241    2581 scope.go:117] "RemoveContainer" containerID="671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"
Jul 06 14:17:55.735442 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:55.735424    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a\": container with ID starting with 671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a not found: ID does not exist" containerID="671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"
Jul 06 14:17:55.735487 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735446    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"} err="failed to get container status \"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a\": rpc error: code = NotFound desc = could not find container \"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a\": container with ID starting with 671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a not found: ID does not exist"
Jul 06 14:17:55.735487 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735459    2581 scope.go:117] "RemoveContainer" containerID="bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"
Jul 06 14:17:55.735684 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735668    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709"} err="failed to get container status \"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709\": rpc error: code = NotFound desc = could not find container \"bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709\": container with ID starting with bc0c4694c2014ad62250d38ff907d2a5f023e14e7793b6f71b6cb7e242420709 not found: ID does not exist"
Jul 06 14:17:55.735723 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735685    2581 scope.go:117] "RemoveContainer" containerID="7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"
Jul 06 14:17:55.735886 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735869    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c"} err="failed to get container status \"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c\": rpc error: code = NotFound desc = could not find container \"7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c\": container with ID starting with 7a80149e28fc75545c5fdc6b7856b67ed42237d002c5399d8030e95f1a99a47c not found: ID does not exist"
Jul 06 14:17:55.735937 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.735886    2581 scope.go:117] "RemoveContainer" containerID="b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"
Jul 06 14:17:55.736122 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736105    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124"} err="failed to get container status \"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124\": rpc error: code = NotFound desc = could not find container \"b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124\": container with ID starting with b847224ce1bd56274b30b00a1d1cfdc46b0da9b1d58fcce403d433e939049124 not found: ID does not exist"
Jul 06 14:17:55.736173 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736124    2581 scope.go:117] "RemoveContainer" containerID="63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"
Jul 06 14:17:55.736392 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736371    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5"} err="failed to get container status \"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5\": rpc error: code = NotFound desc = could not find container \"63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5\": container with ID starting with 63fcd0a5f4691c2f451ca58ca34d352505ab8943e206c7dc89aa63d44916dff5 not found: ID does not exist"
Jul 06 14:17:55.736461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736393    2581 scope.go:117] "RemoveContainer" containerID="8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"
Jul 06 14:17:55.736617 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736601    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4"} err="failed to get container status \"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4\": rpc error: code = NotFound desc = could not find container \"8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4\": container with ID starting with 8b16d2bcf45c1202f95bf9753ce0e8bc439dd8a5377ee1a596ae695871aad4b4 not found: ID does not exist"
Jul 06 14:17:55.736659 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736618    2581 scope.go:117] "RemoveContainer" containerID="2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"
Jul 06 14:17:55.736828 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736811    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be"} err="failed to get container status \"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be\": rpc error: code = NotFound desc = could not find container \"2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be\": container with ID starting with 2789434d5fa59106b9fe4d76bfb320b9b5f4b74e1ede309f6d747548c20748be not found: ID does not exist"
Jul 06 14:17:55.736828 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.736828    2581 scope.go:117] "RemoveContainer" containerID="671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"
Jul 06 14:17:55.737037 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.737020    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a"} err="failed to get container status \"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a\": rpc error: code = NotFound desc = could not find container \"671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a\": container with ID starting with 671fdd364539f4ae40f2582ba0811c7436108b78fd7e1ff02df606c220a5ad3a not found: ID does not exist"
Jul 06 14:17:55.745977 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.745945    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:17:55.845956 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.845924    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:17:55.846210 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846199    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-metric"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846212    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-metric"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846222    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="config-reloader"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846227    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="config-reloader"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846233    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="init-config-reloader"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846238    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="init-config-reloader"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846247    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="prom-label-proxy"
Jul 06 14:17:55.846253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846252    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="prom-label-proxy"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846260    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="alertmanager"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846265    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="alertmanager"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846271    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846277    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846283    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-web"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846288    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-web"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846337    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="config-reloader"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846344    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-web"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846367    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="prom-label-proxy"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846374    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="alertmanager"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846383    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy-metric"
Jul 06 14:17:55.846480 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.846395    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd301595-36e6-4844-8080-ea4350f81541" containerName="kube-rbac-proxy"
Jul 06 14:17:55.849459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.849444    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.851835 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.851815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-config-volume\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.851975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.851879    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-web-config\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.851975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.851914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.851975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.851949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.851975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.851968    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72d851e7-19c0-4505-ae0c-c4854a1af15d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852170 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.851984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72d851e7-19c0-4505-ae0c-c4854a1af15d-config-out\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852170 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852170 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72d851e7-19c0-4505-ae0c-c4854a1af15d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852170 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852117    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6gqb\" (UniqueName: \"kubernetes.io/projected/72d851e7-19c0-4505-ae0c-c4854a1af15d-kube-api-access-h6gqb\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852170 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852193    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852228    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d851e7-19c0-4505-ae0c-c4854a1af15d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.852434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.852270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72d851e7-19c0-4505-ae0c-c4854a1af15d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.869588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869567    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 14:17:55.869588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869584    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 14:17:55.869758 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869571    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 14:17:55.869758 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869568    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 14:17:55.869919 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869904    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 14:17:55.869999 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 14:17:55.869999 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.869974    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 14:17:55.870192 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.870180    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 14:17:55.870232 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.870194    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-5hgn7\""
Jul 06 14:17:55.890007 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.889986    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 14:17:55.904151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.904122    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:17:55.953223 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-config-volume\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953223 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-web-config\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953223 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953528 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953528 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72d851e7-19c0-4505-ae0c-c4854a1af15d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953528 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72d851e7-19c0-4505-ae0c-c4854a1af15d-config-out\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953528 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.953528 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953320    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72d851e7-19c0-4505-ae0c-c4854a1af15d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.954062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6gqb\" (UniqueName: \"kubernetes.io/projected/72d851e7-19c0-4505-ae0c-c4854a1af15d-kube-api-access-h6gqb\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.954062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.954062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.954062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d851e7-19c0-4505-ae0c-c4854a1af15d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.954062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72d851e7-19c0-4505-ae0c-c4854a1af15d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.954062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.953751    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/72d851e7-19c0-4505-ae0c-c4854a1af15d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.956561 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.954516    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72d851e7-19c0-4505-ae0c-c4854a1af15d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.956561 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.955036    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/72d851e7-19c0-4505-ae0c-c4854a1af15d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.957303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.957278    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/72d851e7-19c0-4505-ae0c-c4854a1af15d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.957725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.957440    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-config-volume\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.957725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.957631    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/72d851e7-19c0-4505-ae0c-c4854a1af15d-config-out\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.957725 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.957686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-web-config\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.958015 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.957996    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.958247 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.958226    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.958317 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.958296    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.959307 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.959289    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.959524 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.959505    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/72d851e7-19c0-4505-ae0c-c4854a1af15d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:55.968338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:55.968317    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6gqb\" (UniqueName: \"kubernetes.io/projected/72d851e7-19c0-4505-ae0c-c4854a1af15d-kube-api-access-h6gqb\") pod \"alertmanager-main-0\" (UID: \"72d851e7-19c0-4505-ae0c-c4854a1af15d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:56.158110 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:56.158073    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 14:17:56.312644 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:56.312616    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 14:17:56.314344 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:17:56.314312    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d851e7_19c0_4505_ae0c_c4854a1af15d.slice/crio-b2422788417efed3ba1291e4991c4cdcec1cb87749bb60a7e72edaa7462eec8b WatchSource:0}: Error finding container b2422788417efed3ba1291e4991c4cdcec1cb87749bb60a7e72edaa7462eec8b: Status 404 returned error can't find the container with id b2422788417efed3ba1291e4991c4cdcec1cb87749bb60a7e72edaa7462eec8b
Jul 06 14:17:56.685397 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:56.685337    2581 generic.go:356] "Generic (PLEG): container finished" podID="72d851e7-19c0-4505-ae0c-c4854a1af15d" containerID="61e26ed4609fa3c99dabe19e0a663850230477c46e660524c43b68ce88e11e89" exitCode=0
Jul 06 14:17:56.685869 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:56.685430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerDied","Data":"61e26ed4609fa3c99dabe19e0a663850230477c46e660524c43b68ce88e11e89"}
Jul 06 14:17:56.685869 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:56.685510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"b2422788417efed3ba1291e4991c4cdcec1cb87749bb60a7e72edaa7462eec8b"}
Jul 06 14:17:56.849461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:56.849431    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd301595-36e6-4844-8080-ea4350f81541" path="/var/lib/kubelet/pods/cd301595-36e6-4844-8080-ea4350f81541/volumes"
Jul 06 14:17:57.699463 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.699424    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"1f2a44f8761ff46afa682004b950face3659685e668da5c46742772e9a76b300"}
Jul 06 14:17:57.699907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.699513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"3ee495d54b99214a35ff607ab566382bad56739be909caad1ceda1e7e9388d32"}
Jul 06 14:17:57.699907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.699557    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"23f26a260d2820bbd84d850434258273e917c5bb64107748ca09cd76a0db3136"}
Jul 06 14:17:57.699907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.699595    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"6a7962e8112e90a8c0d2d85ce7de85aa24d9f4df522204a601beba5619a924c3"}
Jul 06 14:17:57.699907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.699633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"47e40c164920383cb1d931db5228a8ef796726ab127b4bf8c10d6b9a16735569"}
Jul 06 14:17:57.699907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.699702    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"72d851e7-19c0-4505-ae0c-c4854a1af15d","Type":"ContainerStarted","Data":"3e029b6e85f8f9dda094d894d702753597f3d6e67c9f4f449edee8af0ba3a24f"}
Jul 06 14:17:57.744874 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:57.744815    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.729100435 podStartE2EDuration="2.744798843s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.698408ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:17:57.743771623 +0000 UTC m=+180.310679315" watchObservedRunningTime="2026-07-06 14:17:57.744798843 +0000 UTC m=+180.311706464"
Jul 06 14:17:58.282456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282408    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:17:58.282778 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282738    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="prometheus" containerID="cri-o://79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02" gracePeriod=600
Jul 06 14:17:58.282778 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282757    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="thanos-sidecar" containerID="cri-o://ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa" gracePeriod=600
Jul 06 14:17:58.283023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282756    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy" containerID="cri-o://d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5" gracePeriod=600
Jul 06 14:17:58.283023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282801    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-thanos" containerID="cri-o://86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156" gracePeriod=600
Jul 06 14:17:58.283023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282819    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="config-reloader" containerID="cri-o://961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0" gracePeriod=600
Jul 06 14:17:58.283023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.282810    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-web" containerID="cri-o://0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a" gracePeriod=600
Jul 06 14:17:58.519056 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.518988    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.575194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575092    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-serving-certs-ca-bundle\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575140    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-kube-rbac-proxy\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575157    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-trusted-ca-bundle\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575179    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-metrics-client-ca\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-tls\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-1\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575476    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575589    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.575798 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-0\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575798 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575648    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.575798 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575657    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.575955 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575829    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-grpc-tls\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575955 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575892    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config-out\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.575955 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-metrics-client-certs\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575954    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-tls-assets\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-kubelet-serving-ca-bundle\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576022    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-db\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576052    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-web-config\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576098    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-2\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-thanos-prometheus-http-client-file\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576161    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwt6j\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-kube-api-access-lwt6j\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576199    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\" (UID: \"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd\") "
Jul 06 14:17:58.576521 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576498    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.576521 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576518    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.576635 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.576531    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-metrics-client-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.576914 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.575824    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.577700 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.577395    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.578129 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.577891    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.578465 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.578420    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:17:58.579045 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579013    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config" (OuterVolumeSpecName: "config") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.579141 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579086    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:58.579415 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579388    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.579618 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579595    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.579752 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579625    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.579870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579830    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config-out" (OuterVolumeSpecName: "config-out") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:17:58.579870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579752    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:58.579870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.579792    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-kube-api-access-lwt6j" (OuterVolumeSpecName: "kube-api-access-lwt6j") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "kube-api-access-lwt6j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:17:58.580072 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.580048    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.580577 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.580555    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.580753 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.580727    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.581108 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.581087    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.589701 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.589675    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-web-config" (OuterVolumeSpecName: "web-config") pod "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" (UID: "63a4ecb9-f440-4fa4-8a6c-f1ca992250fd"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:17:58.677378 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677333    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config-out\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677378 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677377    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-metrics-client-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677378 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677387    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-tls-assets\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677400    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677411    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-db\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677420    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-web-config\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677429    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677436    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677445    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwt6j\" (UniqueName: \"kubernetes.io/projected/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-kube-api-access-lwt6j\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677454    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677463    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-kube-rbac-proxy\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677471    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677479    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677487    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677496    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-config\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677504    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.677629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.677512    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd-secret-grpc-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:17:58.705730 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705696    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156" exitCode=0
Jul 06 14:17:58.705730 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705727    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5" exitCode=0
Jul 06 14:17:58.705730 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705737    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a" exitCode=0
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705746    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa" exitCode=0
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705755    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0" exitCode=0
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705765    2581 generic.go:356] "Generic (PLEG): container finished" podID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02" exitCode=0
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705772    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"}
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705806    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705865    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"}
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"}
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705921    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"}
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"}
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705931    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"}
Jul 06 14:17:58.706178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.705992    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"63a4ecb9-f440-4fa4-8a6c-f1ca992250fd","Type":"ContainerDied","Data":"8839ed116c186ff96f1c04b0c7255b249531e1b33fc8ef44a5e8eef22de3a650"}
Jul 06 14:17:58.713950 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.713794    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.721582 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.721561    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.732073 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.732056    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.734972 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.734942    2581 kuberuntime_gc.go:392] "Failed to remove container log dead symlink" err="remove /var/log/containers/prometheus-k8s-0_openshift-monitoring_thanos-sidecar-ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa.log: no such file or directory" path="/var/log/containers/prometheus-k8s-0_openshift-monitoring_thanos-sidecar-ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa.log"
Jul 06 14:17:58.735324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.735307    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:17:58.740798 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.740770    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:17:58.741213 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.741191    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.748490 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.748463    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.756159 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.756144    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.763313 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.763292    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.763670 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.763648    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.763753 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.763678    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"} err="failed to get container status \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist"
Jul 06 14:17:58.763753 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.763698    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.763941 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.763925    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.763979 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.763948    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"} err="failed to get container status \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist"
Jul 06 14:17:58.763979 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.763964    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.764206 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.764190    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.764250 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764211    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"} err="failed to get container status \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist"
Jul 06 14:17:58.764250 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764225    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.764448 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.764433    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.764495 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764451    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"} err="failed to get container status \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist"
Jul 06 14:17:58.764495 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764465    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.764678 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.764663    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.764716 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764681    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"} err="failed to get container status \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist"
Jul 06 14:17:58.764716 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764695    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.764932 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.764916    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.764984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764935    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"} err="failed to get container status \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist"
Jul 06 14:17:58.764984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.764948    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.765201 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:17:58.765178    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.765237 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765206    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"} err="failed to get container status \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist"
Jul 06 14:17:58.765237 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765221    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.765455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765438    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"} err="failed to get container status \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist"
Jul 06 14:17:58.765455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765455    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.765673 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765648    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"} err="failed to get container status \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist"
Jul 06 14:17:58.765673 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765664    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.765884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765866    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"} err="failed to get container status \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist"
Jul 06 14:17:58.765929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.765884    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.766110 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766093    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"} err="failed to get container status \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist"
Jul 06 14:17:58.766157 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766111    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.766329 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766313    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"} err="failed to get container status \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist"
Jul 06 14:17:58.766385 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766330    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.766559 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766542    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"} err="failed to get container status \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist"
Jul 06 14:17:58.766559 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766559    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.766752 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766737    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"} err="failed to get container status \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist"
Jul 06 14:17:58.766794 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766752    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.766958 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766941    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"} err="failed to get container status \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist"
Jul 06 14:17:58.766958 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.766957    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.767164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767147    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"} err="failed to get container status \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist"
Jul 06 14:17:58.767205 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767164    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.767383 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767347    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"} err="failed to get container status \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist"
Jul 06 14:17:58.767431 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767382    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.767596 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767580    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"} err="failed to get container status \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist"
Jul 06 14:17:58.767645 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767597    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.767793 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767777    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"} err="failed to get container status \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist"
Jul 06 14:17:58.767793 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767792    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.768000 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767983    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"} err="failed to get container status \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist"
Jul 06 14:17:58.768000 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.767999    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.768184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768169    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"} err="failed to get container status \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist"
Jul 06 14:17:58.768225 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768185    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.768425 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768397    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"} err="failed to get container status \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist"
Jul 06 14:17:58.768425 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768425    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.768665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768642    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"} err="failed to get container status \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist"
Jul 06 14:17:58.768665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768664    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.768897 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768879    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"} err="failed to get container status \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist"
Jul 06 14:17:58.768935 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.768907    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.769108 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769089    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"} err="failed to get container status \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist"
Jul 06 14:17:58.769148 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769108    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.769337 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769320    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"} err="failed to get container status \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist"
Jul 06 14:17:58.769423 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769338    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.769627 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769607    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"} err="failed to get container status \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist"
Jul 06 14:17:58.769683 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769627    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.769907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769884    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"} err="failed to get container status \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist"
Jul 06 14:17:58.769964 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.769907    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.770178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770156    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"} err="failed to get container status \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist"
Jul 06 14:17:58.770178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770177    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.770429 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770411    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"} err="failed to get container status \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist"
Jul 06 14:17:58.770477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770430    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.770699 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770681    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"} err="failed to get container status \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist"
Jul 06 14:17:58.770751 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770700    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.771026 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.770990    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"} err="failed to get container status \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist"
Jul 06 14:17:58.771026 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.771014    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.771339 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.771316    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"} err="failed to get container status \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist"
Jul 06 14:17:58.771339 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.771340    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.771673 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.771637    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"} err="failed to get container status \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist"
Jul 06 14:17:58.771785 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.771673    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.772075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772055    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"} err="failed to get container status \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist"
Jul 06 14:17:58.772075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772076    2581 scope.go:117] "RemoveContainer" containerID="86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"
Jul 06 14:17:58.772339 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772320    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156"} err="failed to get container status \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": rpc error: code = NotFound desc = could not find container \"86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156\": container with ID starting with 86ea39967b83d24221a3241afdddc92006c4e5fd90ed13dc798579bcf18e9156 not found: ID does not exist"
Jul 06 14:17:58.772432 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772340    2581 scope.go:117] "RemoveContainer" containerID="d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"
Jul 06 14:17:58.772594 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772577    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5"} err="failed to get container status \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": rpc error: code = NotFound desc = could not find container \"d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5\": container with ID starting with d9a537823a7883719c63f62eabf1ec1478790155b3042f5a46c8bcbb73ddf2f5 not found: ID does not exist"
Jul 06 14:17:58.772634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772595    2581 scope.go:117] "RemoveContainer" containerID="0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"
Jul 06 14:17:58.772834 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772810    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a"} err="failed to get container status \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": rpc error: code = NotFound desc = could not find container \"0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a\": container with ID starting with 0a2706cb3abe2941f05f449ffbb361834ccb0271b54d2fc188953e8b6f02914a not found: ID does not exist"
Jul 06 14:17:58.772911 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.772836    2581 scope.go:117] "RemoveContainer" containerID="ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"
Jul 06 14:17:58.773078 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773060    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa"} err="failed to get container status \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": rpc error: code = NotFound desc = could not find container \"ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa\": container with ID starting with ecaaf3e786f96d3e3ee4c5543b7768813352eb36ab13d8545f8c4a87605759aa not found: ID does not exist"
Jul 06 14:17:58.773122 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773079    2581 scope.go:117] "RemoveContainer" containerID="961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"
Jul 06 14:17:58.773122 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773085    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:17:58.773324 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773306    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0"} err="failed to get container status \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": rpc error: code = NotFound desc = could not find container \"961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0\": container with ID starting with 961d37b4f5f66fdfd8126544e001ed377105730fe603d2302c06849de59979b0 not found: ID does not exist"
Jul 06 14:17:58.773389 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773334    2581 scope.go:117] "RemoveContainer" containerID="79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"
Jul 06 14:17:58.773461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773441    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="prometheus"
Jul 06 14:17:58.773461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773457    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="prometheus"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773468    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773477    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773495    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="init-config-reloader"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773504    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="init-config-reloader"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773513    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-thanos"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773519    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-thanos"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773533    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="config-reloader"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773538    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="config-reloader"
Jul 06 14:17:58.773545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773545    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-web"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773553    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-web"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773565    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="thanos-sidecar"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773571    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="thanos-sidecar"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773564    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02"} err="failed to get container status \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": rpc error: code = NotFound desc = could not find container \"79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02\": container with ID starting with 79deeccd34a22a8f1170a8477bf2d2128eda806f7e743eb6342cff581b83aa02 not found: ID does not exist"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773582    2581 scope.go:117] "RemoveContainer" containerID="ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773621    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="prometheus"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773628    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773637    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-thanos"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773648    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="thanos-sidecar"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773656    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="kube-rbac-proxy-web"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773662    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" containerName="config-reloader"
Jul 06 14:17:58.773799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.773793    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d"} err="failed to get container status \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": rpc error: code = NotFound desc = could not find container \"ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d\": container with ID starting with ebd5fa5bc1c8afb0112e6a5ca698e68a2c01825c636ec965008911426de2885d not found: ID does not exist"
Jul 06 14:17:58.777771 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.777751    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.780729 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.780709    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 14:17:58.780853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.780767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rbtnz\""
Jul 06 14:17:58.780853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.780769    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 14:17:58.780853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.780840    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 14:17:58.784183 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784162    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 14:17:58.784283 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784227    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1n1pnajvho8k4\""
Jul 06 14:17:58.784612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784424    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 14:17:58.784612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784450    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 14:17:58.784612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784466    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 14:17:58.784612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 14:17:58.784612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784424    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 14:17:58.784612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784536    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 14:17:58.784960 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.784609    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 14:17:58.785548 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.785131    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 14:17:58.785548 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.785489    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 14:17:58.787031 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.787009    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 14:17:58.790372 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.790335    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 14:17:58.811533 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.811494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:17:58.854264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.854172    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a4ecb9-f440-4fa4-8a6c-f1ca992250fd" path="/var/lib/kubelet/pods/63a4ecb9-f440-4fa4-8a6c-f1ca992250fd/volumes"
Jul 06 14:17:58.878884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.878884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878889    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878911    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878956    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.878993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-config\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879129    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879153    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e847f5f2-8490-48ae-b87b-8e7e125a20d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879177    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879212    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e847f5f2-8490-48ae-b87b-8e7e125a20d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879226    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.879292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.879282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ksdn\" (UniqueName: \"kubernetes.io/projected/e847f5f2-8490-48ae-b87b-8e7e125a20d7-kube-api-access-8ksdn\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980099 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980099 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-config\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980126    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e847f5f2-8490-48ae-b87b-8e7e125a20d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980179    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980240    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e847f5f2-8490-48ae-b87b-8e7e125a20d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980262    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980587 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980587 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980587 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ksdn\" (UniqueName: \"kubernetes.io/projected/e847f5f2-8490-48ae-b87b-8e7e125a20d7-kube-api-access-8ksdn\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980734 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980734 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980734 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980734 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980773    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.980931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.980869    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.981230 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.981108    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.981591 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.981500    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.982637 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.982598    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.982815 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.982791    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.983386 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.983223    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-config\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.983479 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.983400    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.984174 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.983693    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.984174 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.983966    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.984330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.984312    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.984462 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.984397    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-web-config\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.984462 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.984445    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.984931 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.984905    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.985284 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.985248    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e847f5f2-8490-48ae-b87b-8e7e125a20d7-config-out\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.985720 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.985698    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.985984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.985966    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.986154 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.986135    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e847f5f2-8490-48ae-b87b-8e7e125a20d7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.986217 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.986201    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e847f5f2-8490-48ae-b87b-8e7e125a20d7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.986257 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.986243    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e847f5f2-8490-48ae-b87b-8e7e125a20d7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:58.991046 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:58.991029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ksdn\" (UniqueName: \"kubernetes.io/projected/e847f5f2-8490-48ae-b87b-8e7e125a20d7-kube-api-access-8ksdn\") pod \"prometheus-k8s-0\" (UID: \"e847f5f2-8490-48ae-b87b-8e7e125a20d7\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:59.088476 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:59.088439    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:17:59.244762 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:59.244733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 14:17:59.247708 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:17:59.247685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode847f5f2_8490_48ae_b87b_8e7e125a20d7.slice/crio-81c912081d8e3e682dd4f23b6b24bd42bf378b81048ff84762526ce7b1d7b06a WatchSource:0}: Error finding container 81c912081d8e3e682dd4f23b6b24bd42bf378b81048ff84762526ce7b1d7b06a: Status 404 returned error can't find the container with id 81c912081d8e3e682dd4f23b6b24bd42bf378b81048ff84762526ce7b1d7b06a
Jul 06 14:17:59.712075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:59.712042    2581 generic.go:356] "Generic (PLEG): container finished" podID="e847f5f2-8490-48ae-b87b-8e7e125a20d7" containerID="41a9a831bce475fdbee1ff06bc976214c9d73621b3f8b46ce2dd2eb11dbd24e5" exitCode=0
Jul 06 14:17:59.712488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:59.712109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerDied","Data":"41a9a831bce475fdbee1ff06bc976214c9d73621b3f8b46ce2dd2eb11dbd24e5"}
Jul 06 14:17:59.712488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:17:59.712157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"81c912081d8e3e682dd4f23b6b24bd42bf378b81048ff84762526ce7b1d7b06a"}
Jul 06 14:18:00.719665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.719631    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"34e322530eebc1b6dc307a01d95e0eb7588e211f6b6be41d17cc34cf47faf52c"}
Jul 06 14:18:00.720125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.719708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"bd6dfa56965081e6525bd7dae7690b43dd93a08c5b31b2b309206410d891e0a7"}
Jul 06 14:18:00.720125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.719748    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"13b2ec62dd32933b8e61f4be3359f868c30b4eb716c97f386e29329e241326cb"}
Jul 06 14:18:00.720125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.719791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"9512a3f72918ef0309bbf0cb7d10c90b34d16ad4556aa143017d2fce6e34ef7c"}
Jul 06 14:18:00.720125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.719835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"2beba8b2c2bbe7486ffe5e938a1eff2418bd95ff6e4e2cd63aa197407a264389"}
Jul 06 14:18:00.720125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.719872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e847f5f2-8490-48ae-b87b-8e7e125a20d7","Type":"ContainerStarted","Data":"c94c9322da7fa2e566a11c2eef0fa8797710393fb31d0a40891de2baac114e51"}
Jul 06 14:18:00.748971 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:00.748913    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.729582536 podStartE2EDuration="2.748895868s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.313332ms" isStatefulPod=false podCreationTimestamp="2026-07-06 14:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:18:00.747492607 +0000 UTC m=+183.314400248" watchObservedRunningTime="2026-07-06 14:18:00.748895868 +0000 UTC m=+183.315803488"
Jul 06 14:18:04.089676 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:04.089631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:18:59.089308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:59.089273    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:18:59.104675 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:59.104645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:18:59.964585 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:18:59.964559    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 14:19:40.567297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.567258    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"]
Jul 06 14:19:40.572579 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.572543    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.575364 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.575329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 06 14:19:40.576157 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.576138    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-98nm6\""
Jul 06 14:19:40.576326 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.576309    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 06 14:19:40.576928 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.576911    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 06 14:19:40.577240 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.577225    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 06 14:19:40.590877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.590849    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"]
Jul 06 14:19:40.668608 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.668569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f60f6e-5b29-47eb-808c-d689824f0045-tmp\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.668792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.668627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-569v2\" (UniqueName: \"kubernetes.io/projected/12f60f6e-5b29-47eb-808c-d689824f0045-kube-api-access-569v2\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.668792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.668678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12f60f6e-5b29-47eb-808c-d689824f0045-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.668792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.668695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12f60f6e-5b29-47eb-808c-d689824f0045-manifests\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.668932 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.668804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12f60f6e-5b29-47eb-808c-d689824f0045-webhook-cert\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.770187 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.770150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12f60f6e-5b29-47eb-808c-d689824f0045-webhook-cert\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.770187 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.770191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f60f6e-5b29-47eb-808c-d689824f0045-tmp\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.770467 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.770333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-569v2\" (UniqueName: \"kubernetes.io/projected/12f60f6e-5b29-47eb-808c-d689824f0045-kube-api-access-569v2\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.770467 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.770432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12f60f6e-5b29-47eb-808c-d689824f0045-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.770467 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.770463    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12f60f6e-5b29-47eb-808c-d689824f0045-manifests\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.770784 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.770763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/12f60f6e-5b29-47eb-808c-d689824f0045-manifests\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.772330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.772313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12f60f6e-5b29-47eb-808c-d689824f0045-tmp\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.772705 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.772678    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/12f60f6e-5b29-47eb-808c-d689824f0045-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.772803 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.772703    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12f60f6e-5b29-47eb-808c-d689824f0045-webhook-cert\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.783826 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.783806    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-569v2\" (UniqueName: \"kubernetes.io/projected/12f60f6e-5b29-47eb-808c-d689824f0045-kube-api-access-569v2\") pod \"opendatahub-operator-controller-manager-84ddbc8dff-gf6gb\" (UID: \"12f60f6e-5b29-47eb-808c-d689824f0045\") " pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:40.883230 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:40.883140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:41.031250 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:41.031203    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"]
Jul 06 14:19:41.035184 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:19:41.035158    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12f60f6e_5b29_47eb_808c_d689824f0045.slice/crio-cdc9412af93baf8e7deef44f0d72ff9f1bc0726ae18366aebacc4c6c03c78025 WatchSource:0}: Error finding container cdc9412af93baf8e7deef44f0d72ff9f1bc0726ae18366aebacc4c6c03c78025: Status 404 returned error can't find the container with id cdc9412af93baf8e7deef44f0d72ff9f1bc0726ae18366aebacc4c6c03c78025
Jul 06 14:19:41.108123 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:41.108094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb" event={"ID":"12f60f6e-5b29-47eb-808c-d689824f0045","Type":"ContainerStarted","Data":"cdc9412af93baf8e7deef44f0d72ff9f1bc0726ae18366aebacc4c6c03c78025"}
Jul 06 14:19:44.123629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:44.123593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb" event={"ID":"12f60f6e-5b29-47eb-808c-d689824f0045","Type":"ContainerStarted","Data":"1b6e8390ea56d2a740f3ad671d19101fa7e791829b99a8c666f04076499cd6ea"}
Jul 06 14:19:46.133018 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:46.132989    2581 generic.go:356] "Generic (PLEG): container finished" podID="12f60f6e-5b29-47eb-808c-d689824f0045" containerID="1b6e8390ea56d2a740f3ad671d19101fa7e791829b99a8c666f04076499cd6ea" exitCode=0
Jul 06 14:19:46.133429 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:46.133026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb" event={"ID":"12f60f6e-5b29-47eb-808c-d689824f0045","Type":"ContainerDied","Data":"1b6e8390ea56d2a740f3ad671d19101fa7e791829b99a8c666f04076499cd6ea"}
Jul 06 14:19:47.138897 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:47.138861    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb" event={"ID":"12f60f6e-5b29-47eb-808c-d689824f0045","Type":"ContainerStarted","Data":"340f6acab47b8d829baaeadc4aa5d757aed24178ea8f89d6972521c76ab76446"}
Jul 06 14:19:47.139410 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:47.139085    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:47.198012 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:47.197955    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb" podStartSLOduration=2.742704436 podStartE2EDuration="7.197938913s" totalImagesPullingTime="3.425269146s" totalInitContainerRuntime="1.029965331s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:19:47.196799396 +0000 UTC m=+289.763707040" watchObservedRunningTime="2026-07-06 14:19:47.197938913 +0000 UTC m=+289.764846533"
Jul 06 14:19:58.146173 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.146132    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84ddbc8dff-gf6gb"
Jul 06 14:19:58.561934 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.561898    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"]
Jul 06 14:19:58.568675 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.568649    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.571923 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.571897    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:19:58.572082 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.571970    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 14:19:58.572220 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.572205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 14:19:58.572813 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.572792    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kqdvn\""
Jul 06 14:19:58.572907 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.572878    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 14:19:58.572971 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.572954    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 14:19:58.584426 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.584404    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"]
Jul 06 14:19:58.731537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.731497    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcnvx\" (UniqueName: \"kubernetes.io/projected/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-kube-api-access-zcnvx\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.731727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.731560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-manager-config\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.731727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.731602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-cert\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.731727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.731668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-metrics-cert\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.750823 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.750798    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 06 14:19:58.833058 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.832976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-manager-config\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.833058 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.833020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-cert\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.833245 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.833108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-metrics-cert\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.833245 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.833222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnvx\" (UniqueName: \"kubernetes.io/projected/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-kube-api-access-zcnvx\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.835683 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.835666    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 06 14:19:58.835859 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.835846    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 06 14:19:58.835903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.835894    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 06 14:19:58.841625 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.841599    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 06 14:19:58.843791 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.843765    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-manager-config\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.845730 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.845707    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-cert\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.845865 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.845756    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-metrics-cert\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.852159 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.852132    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 06 14:19:58.862714 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.862692    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnvx\" (UniqueName: \"kubernetes.io/projected/d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0-kube-api-access-zcnvx\") pod \"lws-controller-manager-989c88578-ftd8t\" (UID: \"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0\") " pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:58.880841 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.880813    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-kqdvn\""
Jul 06 14:19:58.888284 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:58.888263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:19:59.051153 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:59.051131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"]
Jul 06 14:19:59.052992 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:19:59.052956    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0e71d10_b793_42f0_b3b8_0d7d1b7ebba0.slice/crio-dc183297e2e893504c516dce7a2af789d87d5a45f50fcbe6ba18a5c7f43d98eb WatchSource:0}: Error finding container dc183297e2e893504c516dce7a2af789d87d5a45f50fcbe6ba18a5c7f43d98eb: Status 404 returned error can't find the container with id dc183297e2e893504c516dce7a2af789d87d5a45f50fcbe6ba18a5c7f43d98eb
Jul 06 14:19:59.191644 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:19:59.191562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t" event={"ID":"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0","Type":"ContainerStarted","Data":"dc183297e2e893504c516dce7a2af789d87d5a45f50fcbe6ba18a5c7f43d98eb"}
Jul 06 14:20:01.421849 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.421801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"]
Jul 06 14:20:01.432146 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.432121    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.436836 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.436815    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 06 14:20:01.437257 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.437205    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-m4zc4\""
Jul 06 14:20:01.437972 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.437954    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 06 14:20:01.503454 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.503343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"]
Jul 06 14:20:01.562094 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.562061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tmp\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.562275 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.562207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdd8\" (UniqueName: \"kubernetes.io/projected/0fabfc4f-0da1-4620-b5d6-8b348d954c37-kube-api-access-wvdd8\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.562343 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.562279    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tls-certs\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.663294 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.663252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tmp\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.663497 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.663345    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdd8\" (UniqueName: \"kubernetes.io/projected/0fabfc4f-0da1-4620-b5d6-8b348d954c37-kube-api-access-wvdd8\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.663497 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.663412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tls-certs\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.663612 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:20:01.663531    2581 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 06 14:20:01.663612 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:20:01.663607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tls-certs podName:0fabfc4f-0da1-4620-b5d6-8b348d954c37 nodeName:}" failed. No retries permitted until 2026-07-06 14:20:02.163585707 +0000 UTC m=+304.730493310 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tls-certs") pod "kube-auth-proxy-6fbc98d46f-47flg" (UID: "0fabfc4f-0da1-4620-b5d6-8b348d954c37") : secret "kube-auth-proxy-tls" not found
Jul 06 14:20:01.665826 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.665800    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tmp\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:01.729558 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:01.729483    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdd8\" (UniqueName: \"kubernetes.io/projected/0fabfc4f-0da1-4620-b5d6-8b348d954c37-kube-api-access-wvdd8\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:02.170137 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.170098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tls-certs\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:02.172538 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.172510    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0fabfc4f-0da1-4620-b5d6-8b348d954c37-tls-certs\") pod \"kube-auth-proxy-6fbc98d46f-47flg\" (UID: \"0fabfc4f-0da1-4620-b5d6-8b348d954c37\") " pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:02.212311 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.212280    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t" event={"ID":"d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0","Type":"ContainerStarted","Data":"5683301f2de075414cc71aa9c8beff3328a7e6247eb007084a2a2ae14ef1c5e3"}
Jul 06 14:20:02.212494 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.212394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:20:02.292570 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.292518    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t" podStartSLOduration=1.355726507 podStartE2EDuration="4.292500069s" totalImagesPullingTime="2.936773562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:02.292156187 +0000 UTC m=+304.859063829" watchObservedRunningTime="2026-07-06 14:20:02.292500069 +0000 UTC m=+304.859407708"
Jul 06 14:20:02.345045 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.345012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"
Jul 06 14:20:02.536391 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.536362    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg"]
Jul 06 14:20:02.537657 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:20:02.537633    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fabfc4f_0da1_4620_b5d6_8b348d954c37.slice/crio-48c62eeee841dd27992257b3570336e3efdb36b58fc9e61993282c190047b661 WatchSource:0}: Error finding container 48c62eeee841dd27992257b3570336e3efdb36b58fc9e61993282c190047b661: Status 404 returned error can't find the container with id 48c62eeee841dd27992257b3570336e3efdb36b58fc9e61993282c190047b661
Jul 06 14:20:02.539652 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:02.539637    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:20:03.217220 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:03.217185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg" event={"ID":"0fabfc4f-0da1-4620-b5d6-8b348d954c37","Type":"ContainerStarted","Data":"48c62eeee841dd27992257b3570336e3efdb36b58fc9e61993282c190047b661"}
Jul 06 14:20:08.245586 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:08.245545    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg" event={"ID":"0fabfc4f-0da1-4620-b5d6-8b348d954c37","Type":"ContainerStarted","Data":"cfc4f9efd1a8623bb7e15554921fa0ac8db0bd1d009329be9fb3e4884d271d71"}
Jul 06 14:20:08.290844 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:08.290790    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6fbc98d46f-47flg" podStartSLOduration=2.621069696 podStartE2EDuration="7.29077354s" totalImagesPullingTime="4.669703844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:20:08.290156054 +0000 UTC m=+310.857063684" watchObservedRunningTime="2026-07-06 14:20:08.29077354 +0000 UTC m=+310.857681160"
Jul 06 14:20:13.219702 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:20:13.219672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-989c88578-ftd8t"
Jul 06 14:21:56.427103 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.427068    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"]
Jul 06 14:21:56.430244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.430228    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.442334 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.442312    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 06 14:21:56.444823 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.444808    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 06 14:21:56.444919 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.444904    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 06 14:21:56.444971 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.444930    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n978r\""
Jul 06 14:21:56.445772 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.445759    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 06 14:21:56.465561 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.465534    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"]
Jul 06 14:21:56.469182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.469155    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8b1c0fa-6a35-42b5-a078-ba874320e024-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.469308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.469207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b1c0fa-6a35-42b5-a078-ba874320e024-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.469308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.469233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4wn4\" (UniqueName: \"kubernetes.io/projected/f8b1c0fa-6a35-42b5-a078-ba874320e024-kube-api-access-r4wn4\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.569939 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.569891    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8b1c0fa-6a35-42b5-a078-ba874320e024-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.569939 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.569955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b1c0fa-6a35-42b5-a078-ba874320e024-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.570182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.569973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4wn4\" (UniqueName: \"kubernetes.io/projected/f8b1c0fa-6a35-42b5-a078-ba874320e024-kube-api-access-r4wn4\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.570645 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.570620    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f8b1c0fa-6a35-42b5-a078-ba874320e024-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.572317 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.572295    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f8b1c0fa-6a35-42b5-a078-ba874320e024-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.578773 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.578753    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4wn4\" (UniqueName: \"kubernetes.io/projected/f8b1c0fa-6a35-42b5-a078-ba874320e024-kube-api-access-r4wn4\") pod \"kuadrant-console-plugin-66b5774985-7vccv\" (UID: \"f8b1c0fa-6a35-42b5-a078-ba874320e024\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.738575 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.738494    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"
Jul 06 14:21:56.878489 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:56.878437    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv"]
Jul 06 14:21:56.880675 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:21:56.880649    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8b1c0fa_6a35_42b5_a078_ba874320e024.slice/crio-6efd537d55e34b3913a698436be05a7b24163aecbb4558e54f4291a26b09ecd2 WatchSource:0}: Error finding container 6efd537d55e34b3913a698436be05a7b24163aecbb4558e54f4291a26b09ecd2: Status 404 returned error can't find the container with id 6efd537d55e34b3913a698436be05a7b24163aecbb4558e54f4291a26b09ecd2
Jul 06 14:21:57.718747 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:21:57.718706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv" event={"ID":"f8b1c0fa-6a35-42b5-a078-ba874320e024","Type":"ContainerStarted","Data":"6efd537d55e34b3913a698436be05a7b24163aecbb4558e54f4291a26b09ecd2"}
Jul 06 14:22:21.844944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:21.844858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv" event={"ID":"f8b1c0fa-6a35-42b5-a078-ba874320e024","Type":"ContainerStarted","Data":"cdb61d023548df9f829b0a4836ad855ab3aaf0b6c58b17c30019de0721ab3d9e"}
Jul 06 14:22:21.898860 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:21.898811    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-7vccv" podStartSLOduration=1.230062665 podStartE2EDuration="25.898795236s" totalImagesPullingTime="24.668732571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:22:21.897266126 +0000 UTC m=+444.464173748" watchObservedRunningTime="2026-07-06 14:22:21.898795236 +0000 UTC m=+444.465702858"
Jul 06 14:22:44.523958 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.523926    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:22:44.527609 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.527587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.530302 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.530283    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 06 14:22:44.545292 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.545260    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:22:44.583452 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.583427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:22:44.604171 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.604148    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlkb\" (UniqueName: \"kubernetes.io/projected/d109d833-47e8-44a5-8543-08e14f63c8bc-kube-api-access-lqlkb\") pod \"limitador-limitador-54d6d988d5-qq27t\" (UID: \"d109d833-47e8-44a5-8543-08e14f63c8bc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.604296 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.604223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d109d833-47e8-44a5-8543-08e14f63c8bc-config-file\") pod \"limitador-limitador-54d6d988d5-qq27t\" (UID: \"d109d833-47e8-44a5-8543-08e14f63c8bc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.705191 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.705153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d109d833-47e8-44a5-8543-08e14f63c8bc-config-file\") pod \"limitador-limitador-54d6d988d5-qq27t\" (UID: \"d109d833-47e8-44a5-8543-08e14f63c8bc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.705406 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.705204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlkb\" (UniqueName: \"kubernetes.io/projected/d109d833-47e8-44a5-8543-08e14f63c8bc-kube-api-access-lqlkb\") pod \"limitador-limitador-54d6d988d5-qq27t\" (UID: \"d109d833-47e8-44a5-8543-08e14f63c8bc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.705896 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.705878    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d109d833-47e8-44a5-8543-08e14f63c8bc-config-file\") pod \"limitador-limitador-54d6d988d5-qq27t\" (UID: \"d109d833-47e8-44a5-8543-08e14f63c8bc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.714437 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.714416    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlkb\" (UniqueName: \"kubernetes.io/projected/d109d833-47e8-44a5-8543-08e14f63c8bc-kube-api-access-lqlkb\") pod \"limitador-limitador-54d6d988d5-qq27t\" (UID: \"d109d833-47e8-44a5-8543-08e14f63c8bc\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.837689 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.837605    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:44.971920 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:44.971898    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:22:44.974430 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:22:44.974396    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd109d833_47e8_44a5_8543_08e14f63c8bc.slice/crio-96dc09577c714bd5733cb113ec8d2bc98ecf14838335fdb373c8701df967a84e WatchSource:0}: Error finding container 96dc09577c714bd5733cb113ec8d2bc98ecf14838335fdb373c8701df967a84e: Status 404 returned error can't find the container with id 96dc09577c714bd5733cb113ec8d2bc98ecf14838335fdb373c8701df967a84e
Jul 06 14:22:45.954130 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:45.954099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t" event={"ID":"d109d833-47e8-44a5-8543-08e14f63c8bc","Type":"ContainerStarted","Data":"96dc09577c714bd5733cb113ec8d2bc98ecf14838335fdb373c8701df967a84e"}
Jul 06 14:22:47.964427 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:47.964392    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t" event={"ID":"d109d833-47e8-44a5-8543-08e14f63c8bc","Type":"ContainerStarted","Data":"c1a557b3c5b44a7f75839617b31e40673b1ab654a89aaa3475aef28a485b0459"}
Jul 06 14:22:47.964917 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:47.964494    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:22:47.986087 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:47.986033    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t" podStartSLOduration=1.5553045540000001 podStartE2EDuration="3.985971393s" totalImagesPullingTime="2.430666839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:22:47.985236021 +0000 UTC m=+470.552143642" watchObservedRunningTime="2026-07-06 14:22:47.985971393 +0000 UTC m=+470.552879019"
Jul 06 14:22:58.969873 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:22:58.969844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-qq27t"
Jul 06 14:25:03.272801 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.272767    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5cc87ffcb6-77b26"]
Jul 06 14:25:03.276267 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.276251    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.286392 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.281799    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 06 14:25:03.293314 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.293290    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5cc87ffcb6-77b26"]
Jul 06 14:25:03.468172 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.468132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljvj8\" (UniqueName: \"kubernetes.io/projected/5bea7a52-6409-43e2-8c78-a81f0878caf8-kube-api-access-ljvj8\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.468416 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.468198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bea7a52-6409-43e2-8c78-a81f0878caf8-maas-api-tls\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.468416 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.468284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bea7a52-6409-43e2-8c78-a81f0878caf8-openshift-service-ca\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.569750 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.569671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bea7a52-6409-43e2-8c78-a81f0878caf8-openshift-service-ca\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.569750 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.569711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljvj8\" (UniqueName: \"kubernetes.io/projected/5bea7a52-6409-43e2-8c78-a81f0878caf8-kube-api-access-ljvj8\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.569924 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.569756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bea7a52-6409-43e2-8c78-a81f0878caf8-maas-api-tls\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.569924 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:25:03.569852    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 06 14:25:03.569924 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:25:03.569909    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bea7a52-6409-43e2-8c78-a81f0878caf8-maas-api-tls podName:5bea7a52-6409-43e2-8c78-a81f0878caf8 nodeName:}" failed. No retries permitted until 2026-07-06 14:25:04.069891977 +0000 UTC m=+606.636799579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5bea7a52-6409-43e2-8c78-a81f0878caf8-maas-api-tls") pod "maas-api-5cc87ffcb6-77b26" (UID: "5bea7a52-6409-43e2-8c78-a81f0878caf8") : secret "maas-api-serving-cert" not found
Jul 06 14:25:03.570478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.570455    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bea7a52-6409-43e2-8c78-a81f0878caf8-openshift-service-ca\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:03.584623 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:03.584592    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljvj8\" (UniqueName: \"kubernetes.io/projected/5bea7a52-6409-43e2-8c78-a81f0878caf8-kube-api-access-ljvj8\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:04.074023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.073983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bea7a52-6409-43e2-8c78-a81f0878caf8-maas-api-tls\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:04.076338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.076313    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5bea7a52-6409-43e2-8c78-a81f0878caf8-maas-api-tls\") pod \"maas-api-5cc87ffcb6-77b26\" (UID: \"5bea7a52-6409-43e2-8c78-a81f0878caf8\") " pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:04.195207 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.195178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:04.218340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.218314    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:25:04.427029 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.426949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5cc87ffcb6-77b26"]
Jul 06 14:25:04.433534 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:25:04.433505    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bea7a52_6409_43e2_8c78_a81f0878caf8.slice/crio-1dfa5915da2191a68320f7c062150cb06cb9c1779aa01c1bb8d9b77b53ce15f2 WatchSource:0}: Error finding container 1dfa5915da2191a68320f7c062150cb06cb9c1779aa01c1bb8d9b77b53ce15f2: Status 404 returned error can't find the container with id 1dfa5915da2191a68320f7c062150cb06cb9c1779aa01c1bb8d9b77b53ce15f2
Jul 06 14:25:04.434718 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.434699    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:25:04.581273 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:04.581235    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5cc87ffcb6-77b26" event={"ID":"5bea7a52-6409-43e2-8c78-a81f0878caf8","Type":"ContainerStarted","Data":"1dfa5915da2191a68320f7c062150cb06cb9c1779aa01c1bb8d9b77b53ce15f2"}
Jul 06 14:25:07.598633 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:07.598587    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5cc87ffcb6-77b26" event={"ID":"5bea7a52-6409-43e2-8c78-a81f0878caf8","Type":"ContainerStarted","Data":"8322cb4a7d249506375227ab53f9b2d68d1a6557a08d22de2ea38f417db338d6"}
Jul 06 14:25:07.599031 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:07.598771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:13.609362 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:13.609318    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5cc87ffcb6-77b26"
Jul 06 14:25:13.654665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:25:13.654618    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5cc87ffcb6-77b26" podStartSLOduration=7.710969449 podStartE2EDuration="10.654602661s" totalImagesPullingTime="2.943633212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:25:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:25:07.628582692 +0000 UTC m=+610.195490314" watchObservedRunningTime="2026-07-06 14:25:13.654602661 +0000 UTC m=+616.221510281"
Jul 06 14:26:09.223562 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.223526    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"]
Jul 06 14:26:09.227146 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.227126    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.234471 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.234453    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 06 14:26:09.234592 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.234501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 06 14:26:09.235182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.235163    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lrj5c\""
Jul 06 14:26:09.240155 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.240139    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 06 14:26:09.259524 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.259496    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"]
Jul 06 14:26:09.356705 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.356668    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.356705 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.356711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9401f0c-942a-4ab3-b97d-fa831007f105-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.356947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.356747    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.356947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.356783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.356947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.356799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn2k9\" (UniqueName: \"kubernetes.io/projected/f9401f0c-942a-4ab3-b97d-fa831007f105-kube-api-access-pn2k9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.356947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.356849    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.457490 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9401f0c-942a-4ab3-b97d-fa831007f105-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.457665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.457665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.457665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn2k9\" (UniqueName: \"kubernetes.io/projected/f9401f0c-942a-4ab3-b97d-fa831007f105-kube-api-access-pn2k9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.457665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457607    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.457665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.458002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.457974    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.458002 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.458002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.458187 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.458040    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.459822 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.459798    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f9401f0c-942a-4ab3-b97d-fa831007f105-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.460007 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.459990    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f9401f0c-942a-4ab3-b97d-fa831007f105-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.472419 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.472399    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn2k9\" (UniqueName: \"kubernetes.io/projected/f9401f0c-942a-4ab3-b97d-fa831007f105-kube-api-access-pn2k9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22\" (UID: \"f9401f0c-942a-4ab3-b97d-fa831007f105\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.537489 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.537453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:09.690512 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.690478    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"]
Jul 06 14:26:09.694504 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:26:09.694478    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9401f0c_942a_4ab3_b97d_fa831007f105.slice/crio-07377508a98071b1d4e92780990b0c2de11fd0dfd422796f80fe803ac7f4001a WatchSource:0}: Error finding container 07377508a98071b1d4e92780990b0c2de11fd0dfd422796f80fe803ac7f4001a: Status 404 returned error can't find the container with id 07377508a98071b1d4e92780990b0c2de11fd0dfd422796f80fe803ac7f4001a
Jul 06 14:26:09.882233 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.882146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22" event={"ID":"f9401f0c-942a-4ab3-b97d-fa831007f105","Type":"ContainerStarted","Data":"07377508a98071b1d4e92780990b0c2de11fd0dfd422796f80fe803ac7f4001a"}
Jul 06 14:26:09.964276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:09.964242    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:26:11.891711 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:11.891677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22" event={"ID":"f9401f0c-942a-4ab3-b97d-fa831007f105","Type":"ContainerStarted","Data":"dbf9ac6c7da24c7f3b08e811e2588a7bdbe97745fdc86c9d4028f5550366aff6"}
Jul 06 14:26:18.577614 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:18.577556    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22" podStartSLOduration=8.391242273 podStartE2EDuration="9.57753849s" totalImagesPullingTime="1.186296217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:26:11.921162959 +0000 UTC m=+674.488070581" watchObservedRunningTime="2026-07-06 14:26:18.57753849 +0000 UTC m=+681.144446147"
Jul 06 14:26:18.578028 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:18.577830    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:26:19.538271 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:19.538239    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:19.538461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:19.538330    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:19.551020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:19.550992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:19.939297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:19.939215    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22"
Jul 06 14:26:40.405016 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:40.404980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:26:52.991492 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:26:52.991405    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:27:14.000546 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.000511    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"]
Jul 06 14:27:14.004224 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.004207    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.012610 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.012587    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 06 14:27:14.027773 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.027746    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"]
Jul 06 14:27:14.050804 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.050771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.050804 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.050802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.050985 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.050831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmql\" (UniqueName: \"kubernetes.io/projected/4c4f3919-7e25-45e5-97b0-6e53042da17e-kube-api-access-twmql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.050985 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.050877    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.050985 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.050921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4f3919-7e25-45e5-97b0-6e53042da17e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.050985 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.050975    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.151598 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.151559    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.151775 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.151640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.151775 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.151661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.151775 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.151702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmql\" (UniqueName: \"kubernetes.io/projected/4c4f3919-7e25-45e5-97b0-6e53042da17e-kube-api-access-twmql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.151775 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.151723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.151775 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.151741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4f3919-7e25-45e5-97b0-6e53042da17e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.152077 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.152049    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.152077 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.152058    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.152184 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.152154    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.153954 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.153934    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4c4f3919-7e25-45e5-97b0-6e53042da17e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.154260 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.154245    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c4f3919-7e25-45e5-97b0-6e53042da17e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.166162 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.166131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmql\" (UniqueName: \"kubernetes.io/projected/4c4f3919-7e25-45e5-97b0-6e53042da17e-kube-api-access-twmql\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-hdgdx\" (UID: \"4c4f3919-7e25-45e5-97b0-6e53042da17e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.315582 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.315493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:14.470606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:14.470577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"]
Jul 06 14:27:14.474114 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:27:14.474086    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c4f3919_7e25_45e5_97b0_6e53042da17e.slice/crio-9bdc11ac5b302073cdd5019b819a6d8bd6f907efe767229785780567bf4aa8ed WatchSource:0}: Error finding container 9bdc11ac5b302073cdd5019b819a6d8bd6f907efe767229785780567bf4aa8ed: Status 404 returned error can't find the container with id 9bdc11ac5b302073cdd5019b819a6d8bd6f907efe767229785780567bf4aa8ed
Jul 06 14:27:15.175120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:15.175084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx" event={"ID":"4c4f3919-7e25-45e5-97b0-6e53042da17e","Type":"ContainerStarted","Data":"f49779c34bbae7fae5ba29738bff2f654f04a78e449350c89a09b9c682b4eed4"}
Jul 06 14:27:15.175516 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:15.175139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx" event={"ID":"4c4f3919-7e25-45e5-97b0-6e53042da17e","Type":"ContainerStarted","Data":"9bdc11ac5b302073cdd5019b819a6d8bd6f907efe767229785780567bf4aa8ed"}
Jul 06 14:27:15.196862 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:15.196809    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx" podStartSLOduration=1.9363157960000001 podStartE2EDuration="2.196793008s" totalImagesPullingTime="260.477212ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:15.194405453 +0000 UTC m=+737.761313097" watchObservedRunningTime="2026-07-06 14:27:15.196793008 +0000 UTC m=+737.763700628"
Jul 06 14:27:16.091629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:16.091591    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:27:19.409552 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.409518    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"]
Jul 06 14:27:19.412760 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.412743    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.416700 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.416682    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 06 14:27:19.439499 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.439466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"]
Jul 06 14:27:19.501391 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.501335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.501564 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.501404    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.501564 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.501429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.501564 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.501445    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6494efbb-1d75-434b-8723-0e7d98387e77-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.501564 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.501471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcwht\" (UniqueName: \"kubernetes.io/projected/6494efbb-1d75-434b-8723-0e7d98387e77-kube-api-access-zcwht\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.501564 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.501541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.602748 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.602711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.602748 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.602747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.602963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.602767    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.602963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.602786    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6494efbb-1d75-434b-8723-0e7d98387e77-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.602963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.602807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcwht\" (UniqueName: \"kubernetes.io/projected/6494efbb-1d75-434b-8723-0e7d98387e77-kube-api-access-zcwht\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.602963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.602838    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.603203 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.603178    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.603270 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.603230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.603413 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.603390    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.605045 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.605027    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6494efbb-1d75-434b-8723-0e7d98387e77-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.605299 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.605273    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6494efbb-1d75-434b-8723-0e7d98387e77-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.625165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.625136    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcwht\" (UniqueName: \"kubernetes.io/projected/6494efbb-1d75-434b-8723-0e7d98387e77-kube-api-access-zcwht\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn\" (UID: \"6494efbb-1d75-434b-8723-0e7d98387e77\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.722138 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.722051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:19.884853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:19.884820    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"]
Jul 06 14:27:19.890183 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:27:19.890156    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6494efbb_1d75_434b_8723_0e7d98387e77.slice/crio-dfa9fbcf53c8b9275f861f2dd07d612526269bfefc9f4c623becb8e9c593d30a WatchSource:0}: Error finding container dfa9fbcf53c8b9275f861f2dd07d612526269bfefc9f4c623becb8e9c593d30a: Status 404 returned error can't find the container with id dfa9fbcf53c8b9275f861f2dd07d612526269bfefc9f4c623becb8e9c593d30a
Jul 06 14:27:20.199325 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:20.199285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn" event={"ID":"6494efbb-1d75-434b-8723-0e7d98387e77","Type":"ContainerStarted","Data":"e20f4b41df5914b50c101533fa934b2ff0da17303df6c6c681af503bcef4b13d"}
Jul 06 14:27:20.199500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:20.199333    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn" event={"ID":"6494efbb-1d75-434b-8723-0e7d98387e77","Type":"ContainerStarted","Data":"dfa9fbcf53c8b9275f861f2dd07d612526269bfefc9f4c623becb8e9c593d30a"}
Jul 06 14:27:20.242618 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:20.242565    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn" podStartSLOduration=1.032831734 podStartE2EDuration="1.242546015s" totalImagesPullingTime="209.714281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:27:20.238656904 +0000 UTC m=+742.805564517" watchObservedRunningTime="2026-07-06 14:27:20.242546015 +0000 UTC m=+742.809453637"
Jul 06 14:27:23.849665 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:23.849631    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:27:24.316219 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:24.316187    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:24.316445 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:24.316247    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:24.329025 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:24.329000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:25.234488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:25.234462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-hdgdx"
Jul 06 14:27:29.722463 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:29.722433    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:29.722463 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:29.722472    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:29.734792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:29.734767    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:27:30.260102 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:27:30.260076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn"
Jul 06 14:28:54.884723 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:28:54.884680    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:29:03.457500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:29:03.457468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:29:11.254204 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:29:11.254171    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:29:21.181235 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:29:21.181199    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:29:32.077199 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:29:32.077159    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:29:39.985428 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:29:39.985392    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:30:50.104940 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:30:50.104904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:30:57.580441 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:30:57.580407    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:31:08.795705 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:31:08.795665    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:31:17.227916 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:31:17.227879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:31:28.779410 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:31:28.779312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:31:38.590909 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:31:38.590878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:31:51.178988 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:31:51.178951    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:32:00.971256 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:32:00.971217    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:32:22.988944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:32:22.988909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:32:33.879149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:32:33.879115    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:33:01.413106 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:33:01.413027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:33:15.670835 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:33:15.670806    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:33:26.086818 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:33:26.086784    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:33:36.263474 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:33:36.263440    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:33:46.175653 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:33:46.175618    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:33:55.583852 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:33:55.583818    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:34:04.978050 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:34:04.978021    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:35:52.777730 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:35:52.777646    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:36:04.485751 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:36:04.485717    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:36:13.970333 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:36:13.970294    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:36:23.270196 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:36:23.270160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:36:40.779247 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:36:40.779202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:36:50.898023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:36:50.897992    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:37:02.997957 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:37:02.997923    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:37:11.134424 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:37:11.134388    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:37:22.864239 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:37:22.864137    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:37:36.019537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:37:36.019502    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:37:43.786606 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:37:43.786570    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:38:02.044842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:38:02.044810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:38:11.992681 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:38:11.992649    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:38:22.093515 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:38:22.093483    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:38:33.999054 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:38:33.999013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:38:51.376481 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:38:51.376403    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:39:01.385545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:39:01.385495    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:39:11.183482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:39:11.183442    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:39:19.375975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:39:19.375940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:39:29.586990 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:39:29.586954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:39:39.476598 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:39:39.476563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:39:49.861673 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:39:49.861639    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:40:01.871237 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:40:01.871202    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:40:11.662730 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:40:11.662691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:40:23.458465 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:40:23.458381    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:40:36.090662 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:40:36.090627    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:40:44.476181 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:40:44.476151    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:40:54.499699 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:40:54.499665    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:41:09.971463 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:09.971433    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:41:22.965335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:22.965299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:41:36.854371 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.854317    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"]
Jul 06 14:41:36.857631 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.857614    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:36.865047 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.865024    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-6f5d260e-serving-cert\""
Jul 06 14:41:36.865163 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.865137    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:41:36.901189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.901162    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"]
Jul 06 14:41:36.958676 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.958636    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg5vd\" (UniqueName: \"kubernetes.io/projected/03b67351-9fda-49e8-998e-93d46e6daff7-kube-api-access-sg5vd\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:36.958881 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.958856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:36.958961 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:36.958939    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b67351-9fda-49e8-998e-93d46e6daff7-openshift-service-ca\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.060186 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.060150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg5vd\" (UniqueName: \"kubernetes.io/projected/03b67351-9fda-49e8-998e-93d46e6daff7-kube-api-access-sg5vd\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.060394 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.060213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.060394 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.060251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b67351-9fda-49e8-998e-93d46e6daff7-openshift-service-ca\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.060528 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:41:37.060396    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-6f5d260e-serving-cert: secret "maas-api-e2e-ait-6f5d260e-serving-cert" not found
Jul 06 14:41:37.060528 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:41:37.060472    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls podName:03b67351-9fda-49e8-998e-93d46e6daff7 nodeName:}" failed. No retries permitted until 2026-07-06 14:41:37.560450501 +0000 UTC m=+1600.127358100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls") pod "maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" (UID: "03b67351-9fda-49e8-998e-93d46e6daff7") : secret "maas-api-e2e-ait-6f5d260e-serving-cert" not found
Jul 06 14:41:37.060980 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.060960    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b67351-9fda-49e8-998e-93d46e6daff7-openshift-service-ca\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.090461 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.090429    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg5vd\" (UniqueName: \"kubernetes.io/projected/03b67351-9fda-49e8-998e-93d46e6daff7-kube-api-access-sg5vd\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.565829 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.565791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.568209 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.568189    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls\") pod \"maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") " pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.767903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.767867    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:37.914140 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.914116    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"]
Jul 06 14:41:37.916098 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:41:37.916068    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b67351_9fda_49e8_998e_93d46e6daff7.slice/crio-72c53ed03f390164315e1aa65f80cb100444c833acde5effbd430a281cc61326 WatchSource:0}: Error finding container 72c53ed03f390164315e1aa65f80cb100444c833acde5effbd430a281cc61326: Status 404 returned error can't find the container with id 72c53ed03f390164315e1aa65f80cb100444c833acde5effbd430a281cc61326
Jul 06 14:41:37.917515 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:37.917497    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:41:38.214588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:38.214502    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" event={"ID":"03b67351-9fda-49e8-998e-93d46e6daff7","Type":"ContainerStarted","Data":"72c53ed03f390164315e1aa65f80cb100444c833acde5effbd430a281cc61326"}
Jul 06 14:41:39.220392 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:39.220343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" event={"ID":"03b67351-9fda-49e8-998e-93d46e6daff7","Type":"ContainerStarted","Data":"6f59756995a75ad4980f343308aa482d35b89a74725740b0ecffff8c7db1a2f3"}
Jul 06 14:41:39.220869 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:39.220464    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:39.241439 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:39.241255    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" podStartSLOduration=2.656923201 podStartE2EDuration="3.241236796s" totalImagesPullingTime="584.313595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:41:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:41:39.240889575 +0000 UTC m=+1601.807797193" watchObservedRunningTime="2026-07-06 14:41:39.241236796 +0000 UTC m=+1601.808144418"
Jul 06 14:41:42.114475 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.114447    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"]
Jul 06 14:41:42.114939 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.114620    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" podUID="03b67351-9fda-49e8-998e-93d46e6daff7" containerName="maas-api" containerID="cri-o://6f59756995a75ad4980f343308aa482d35b89a74725740b0ecffff8c7db1a2f3" gracePeriod=30
Jul 06 14:41:42.236531 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.236501    2581 generic.go:356] "Generic (PLEG): container finished" podID="03b67351-9fda-49e8-998e-93d46e6daff7" containerID="6f59756995a75ad4980f343308aa482d35b89a74725740b0ecffff8c7db1a2f3" exitCode=0
Jul 06 14:41:42.236664 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.236540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" event={"ID":"03b67351-9fda-49e8-998e-93d46e6daff7","Type":"ContainerDied","Data":"6f59756995a75ad4980f343308aa482d35b89a74725740b0ecffff8c7db1a2f3"}
Jul 06 14:41:42.360287 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.360263    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:42.411750 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.411670    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b67351-9fda-49e8-998e-93d46e6daff7-openshift-service-ca\") pod \"03b67351-9fda-49e8-998e-93d46e6daff7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") "
Jul 06 14:41:42.411883 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.411782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg5vd\" (UniqueName: \"kubernetes.io/projected/03b67351-9fda-49e8-998e-93d46e6daff7-kube-api-access-sg5vd\") pod \"03b67351-9fda-49e8-998e-93d46e6daff7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") "
Jul 06 14:41:42.411883 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.411809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls\") pod \"03b67351-9fda-49e8-998e-93d46e6daff7\" (UID: \"03b67351-9fda-49e8-998e-93d46e6daff7\") "
Jul 06 14:41:42.412063 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.412039    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03b67351-9fda-49e8-998e-93d46e6daff7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03b67351-9fda-49e8-998e-93d46e6daff7" (UID: "03b67351-9fda-49e8-998e-93d46e6daff7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:41:42.413959 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.413932    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03b67351-9fda-49e8-998e-93d46e6daff7" (UID: "03b67351-9fda-49e8-998e-93d46e6daff7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:41:42.414080 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.413978    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03b67351-9fda-49e8-998e-93d46e6daff7-kube-api-access-sg5vd" (OuterVolumeSpecName: "kube-api-access-sg5vd") pod "03b67351-9fda-49e8-998e-93d46e6daff7" (UID: "03b67351-9fda-49e8-998e-93d46e6daff7"). InnerVolumeSpecName "kube-api-access-sg5vd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:41:42.513097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.513053    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03b67351-9fda-49e8-998e-93d46e6daff7-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:41:42.513097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.513091    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg5vd\" (UniqueName: \"kubernetes.io/projected/03b67351-9fda-49e8-998e-93d46e6daff7-kube-api-access-sg5vd\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:41:42.513097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:42.513102    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03b67351-9fda-49e8-998e-93d46e6daff7-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:41:43.242507 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:43.242424    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"
Jul 06 14:41:43.242507 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:43.242454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7" event={"ID":"03b67351-9fda-49e8-998e-93d46e6daff7","Type":"ContainerDied","Data":"72c53ed03f390164315e1aa65f80cb100444c833acde5effbd430a281cc61326"}
Jul 06 14:41:43.243053 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:43.242525    2581 scope.go:117] "RemoveContainer" containerID="6f59756995a75ad4980f343308aa482d35b89a74725740b0ecffff8c7db1a2f3"
Jul 06 14:41:43.259918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:43.259882    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"]
Jul 06 14:41:43.264236 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:43.264210    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-6f5d260e-84bbf59fbf-thgx7"]
Jul 06 14:41:44.850951 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:44.850921    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03b67351-9fda-49e8-998e-93d46e6daff7" path="/var/lib/kubelet/pods/03b67351-9fda-49e8-998e-93d46e6daff7/volumes"
Jul 06 14:41:50.537368 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.537280    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"]
Jul 06 14:41:50.537909 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.537885    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03b67351-9fda-49e8-998e-93d46e6daff7" containerName="maas-api"
Jul 06 14:41:50.537909 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.537910    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="03b67351-9fda-49e8-998e-93d46e6daff7" containerName="maas-api"
Jul 06 14:41:50.538105 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.538003    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="03b67351-9fda-49e8-998e-93d46e6daff7" containerName="maas-api"
Jul 06 14:41:50.542728 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.542710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.545036 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.545018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-15e000e5-serving-cert\""
Jul 06 14:41:50.545595 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.545579    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:41:50.550140 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.550118    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"]
Jul 06 14:41:50.587657 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.587630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxmmc\" (UniqueName: \"kubernetes.io/projected/e99b32fa-e65b-4968-9f54-8d5203da3be4-kube-api-access-fxmmc\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.587797 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.587666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.587797 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.587689    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99b32fa-e65b-4968-9f54-8d5203da3be4-openshift-service-ca\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.688182 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.688150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxmmc\" (UniqueName: \"kubernetes.io/projected/e99b32fa-e65b-4968-9f54-8d5203da3be4-kube-api-access-fxmmc\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.688341 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.688197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.688341 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.688227    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99b32fa-e65b-4968-9f54-8d5203da3be4-openshift-service-ca\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.688432 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:41:50.688378    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-15e000e5-serving-cert: secret "maas-api-e2e-ait-15e000e5-serving-cert" not found
Jul 06 14:41:50.688472 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:41:50.688450    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls podName:e99b32fa-e65b-4968-9f54-8d5203da3be4 nodeName:}" failed. No retries permitted until 2026-07-06 14:41:51.188428061 +0000 UTC m=+1613.755335672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls") pod "maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" (UID: "e99b32fa-e65b-4968-9f54-8d5203da3be4") : secret "maas-api-e2e-ait-15e000e5-serving-cert" not found
Jul 06 14:41:50.688953 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.688935    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99b32fa-e65b-4968-9f54-8d5203da3be4-openshift-service-ca\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:50.706162 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:50.706131    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxmmc\" (UniqueName: \"kubernetes.io/projected/e99b32fa-e65b-4968-9f54-8d5203da3be4-kube-api-access-fxmmc\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:51.193991 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:51.193958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:51.196387 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:51.196362    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls\") pod \"maas-api-e2e-ait-15e000e5-57f95687b4-69s9x\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") " pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:51.455995 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:51.455894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:51.592629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:51.592600    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"]
Jul 06 14:41:51.596083 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:41:51.596056    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99b32fa_e65b_4968_9f54_8d5203da3be4.slice/crio-7aff4cf77fa92f96e1d614dd7ad179c7aadd8d27b278eb4a89d366cc018e7f3a WatchSource:0}: Error finding container 7aff4cf77fa92f96e1d614dd7ad179c7aadd8d27b278eb4a89d366cc018e7f3a: Status 404 returned error can't find the container with id 7aff4cf77fa92f96e1d614dd7ad179c7aadd8d27b278eb4a89d366cc018e7f3a
Jul 06 14:41:52.285609 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:52.285572    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" event={"ID":"e99b32fa-e65b-4968-9f54-8d5203da3be4","Type":"ContainerStarted","Data":"471b01b52f42d12d3478be95e54252830af5a9ddecd5e361e0524a90b06630fa"}
Jul 06 14:41:52.285764 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:52.285633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" event={"ID":"e99b32fa-e65b-4968-9f54-8d5203da3be4","Type":"ContainerStarted","Data":"7aff4cf77fa92f96e1d614dd7ad179c7aadd8d27b278eb4a89d366cc018e7f3a"}
Jul 06 14:41:52.285764 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:52.285657    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:52.308214 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:52.308120    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" podStartSLOduration=1.8482382689999999 podStartE2EDuration="2.308105632s" totalImagesPullingTime="459.867363ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:41:52.306458819 +0000 UTC m=+1614.873366444" watchObservedRunningTime="2026-07-06 14:41:52.308105632 +0000 UTC m=+1614.875013250"
Jul 06 14:41:53.071661 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:53.071632    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:41:56.088086 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.088058    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"]
Jul 06 14:41:56.088564 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.088239    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" podUID="e99b32fa-e65b-4968-9f54-8d5203da3be4" containerName="maas-api" containerID="cri-o://471b01b52f42d12d3478be95e54252830af5a9ddecd5e361e0524a90b06630fa" gracePeriod=30
Jul 06 14:41:56.305464 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.305434    2581 generic.go:356] "Generic (PLEG): container finished" podID="e99b32fa-e65b-4968-9f54-8d5203da3be4" containerID="471b01b52f42d12d3478be95e54252830af5a9ddecd5e361e0524a90b06630fa" exitCode=0
Jul 06 14:41:56.305633 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.305509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" event={"ID":"e99b32fa-e65b-4968-9f54-8d5203da3be4","Type":"ContainerDied","Data":"471b01b52f42d12d3478be95e54252830af5a9ddecd5e361e0524a90b06630fa"}
Jul 06 14:41:56.339856 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.339792    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:56.442658 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.442619    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99b32fa-e65b-4968-9f54-8d5203da3be4-openshift-service-ca\") pod \"e99b32fa-e65b-4968-9f54-8d5203da3be4\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") "
Jul 06 14:41:56.442845 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.442675    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls\") pod \"e99b32fa-e65b-4968-9f54-8d5203da3be4\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") "
Jul 06 14:41:56.442845 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.442714    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxmmc\" (UniqueName: \"kubernetes.io/projected/e99b32fa-e65b-4968-9f54-8d5203da3be4-kube-api-access-fxmmc\") pod \"e99b32fa-e65b-4968-9f54-8d5203da3be4\" (UID: \"e99b32fa-e65b-4968-9f54-8d5203da3be4\") "
Jul 06 14:41:56.443014 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.442980    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e99b32fa-e65b-4968-9f54-8d5203da3be4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e99b32fa-e65b-4968-9f54-8d5203da3be4" (UID: "e99b32fa-e65b-4968-9f54-8d5203da3be4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:41:56.444833 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.444814    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e99b32fa-e65b-4968-9f54-8d5203da3be4" (UID: "e99b32fa-e65b-4968-9f54-8d5203da3be4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:41:56.444939 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.444883    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99b32fa-e65b-4968-9f54-8d5203da3be4-kube-api-access-fxmmc" (OuterVolumeSpecName: "kube-api-access-fxmmc") pod "e99b32fa-e65b-4968-9f54-8d5203da3be4" (UID: "e99b32fa-e65b-4968-9f54-8d5203da3be4"). InnerVolumeSpecName "kube-api-access-fxmmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:41:56.543403 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.543369    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99b32fa-e65b-4968-9f54-8d5203da3be4-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:41:56.543403 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.543395    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxmmc\" (UniqueName: \"kubernetes.io/projected/e99b32fa-e65b-4968-9f54-8d5203da3be4-kube-api-access-fxmmc\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:41:56.543403 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:56.543405    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99b32fa-e65b-4968-9f54-8d5203da3be4-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:41:57.311437 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:57.311400    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x" event={"ID":"e99b32fa-e65b-4968-9f54-8d5203da3be4","Type":"ContainerDied","Data":"7aff4cf77fa92f96e1d614dd7ad179c7aadd8d27b278eb4a89d366cc018e7f3a"}
Jul 06 14:41:57.311823 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:57.311503    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"
Jul 06 14:41:57.311823 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:57.311506    2581 scope.go:117] "RemoveContainer" containerID="471b01b52f42d12d3478be95e54252830af5a9ddecd5e361e0524a90b06630fa"
Jul 06 14:41:57.329243 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:57.329218    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"]
Jul 06 14:41:57.336518 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:57.336486    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-15e000e5-57f95687b4-69s9x"]
Jul 06 14:41:58.851161 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:41:58.851133    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99b32fa-e65b-4968-9f54-8d5203da3be4" path="/var/lib/kubelet/pods/e99b32fa-e65b-4968-9f54-8d5203da3be4/volumes"
Jul 06 14:42:04.965762 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:04.965733    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:42:10.709114 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.709079    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"]
Jul 06 14:42:10.709682 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.709663    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99b32fa-e65b-4968-9f54-8d5203da3be4" containerName="maas-api"
Jul 06 14:42:10.709727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.709686    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99b32fa-e65b-4968-9f54-8d5203da3be4" containerName="maas-api"
Jul 06 14:42:10.709816 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.709805    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e99b32fa-e65b-4968-9f54-8d5203da3be4" containerName="maas-api"
Jul 06 14:42:10.713284 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.713257    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.718919 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.718895    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:42:10.719476 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.719451    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-5e4b6a62-serving-cert\""
Jul 06 14:42:10.725799 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.725771    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"]
Jul 06 14:42:10.881098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.881060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dfvv\" (UniqueName: \"kubernetes.io/projected/5b3efde2-036f-4030-88ba-0f7c1f359df9-kube-api-access-8dfvv\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.881277 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.881214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b3efde2-036f-4030-88ba-0f7c1f359df9-openshift-service-ca\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.881277 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.881255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.981908 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.981797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b3efde2-036f-4030-88ba-0f7c1f359df9-openshift-service-ca\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.981908 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.981868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.982151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.981928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dfvv\" (UniqueName: \"kubernetes.io/projected/5b3efde2-036f-4030-88ba-0f7c1f359df9-kube-api-access-8dfvv\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.982151 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:42:10.982041    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-5e4b6a62-serving-cert: secret "maas-api-e2e-derive-5e4b6a62-serving-cert" not found
Jul 06 14:42:10.982151 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:42:10.982124    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls podName:5b3efde2-036f-4030-88ba-0f7c1f359df9 nodeName:}" failed. No retries permitted until 2026-07-06 14:42:11.482102495 +0000 UTC m=+1634.049010100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls") pod "maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" (UID: "5b3efde2-036f-4030-88ba-0f7c1f359df9") : secret "maas-api-e2e-derive-5e4b6a62-serving-cert" not found
Jul 06 14:42:10.982708 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.982689    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b3efde2-036f-4030-88ba-0f7c1f359df9-openshift-service-ca\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:10.993314 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:10.993287    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dfvv\" (UniqueName: \"kubernetes.io/projected/5b3efde2-036f-4030-88ba-0f7c1f359df9-kube-api-access-8dfvv\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:11.487526 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:11.487486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:11.487714 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:42:11.487636    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-5e4b6a62-serving-cert: secret "maas-api-e2e-derive-5e4b6a62-serving-cert" not found
Jul 06 14:42:11.487714 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:42:11.487699    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls podName:5b3efde2-036f-4030-88ba-0f7c1f359df9 nodeName:}" failed. No retries permitted until 2026-07-06 14:42:12.487684468 +0000 UTC m=+1635.054592066 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls") pod "maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" (UID: "5b3efde2-036f-4030-88ba-0f7c1f359df9") : secret "maas-api-e2e-derive-5e4b6a62-serving-cert" not found
Jul 06 14:42:12.495563 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:12.495530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:12.497960 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:12.497931    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") pod \"maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") " pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:12.525390 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:12.525334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:12.667710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:12.667685    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"]
Jul 06 14:42:12.669896 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:42:12.669860    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3efde2_036f_4030_88ba_0f7c1f359df9.slice/crio-78d9713a60ffed887b634bd78aef6decd70f817395c6782a4abcd18dff93b58b WatchSource:0}: Error finding container 78d9713a60ffed887b634bd78aef6decd70f817395c6782a4abcd18dff93b58b: Status 404 returned error can't find the container with id 78d9713a60ffed887b634bd78aef6decd70f817395c6782a4abcd18dff93b58b
Jul 06 14:42:13.392416 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:13.392313    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" event={"ID":"5b3efde2-036f-4030-88ba-0f7c1f359df9","Type":"ContainerStarted","Data":"237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401"}
Jul 06 14:42:13.392416 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:13.392390    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" event={"ID":"5b3efde2-036f-4030-88ba-0f7c1f359df9","Type":"ContainerStarted","Data":"78d9713a60ffed887b634bd78aef6decd70f817395c6782a4abcd18dff93b58b"}
Jul 06 14:42:13.392667 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:13.392528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:13.414578 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:13.414528    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" podStartSLOduration=3.050840679 podStartE2EDuration="3.414513048s" totalImagesPullingTime="363.672369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:42:13.412334828 +0000 UTC m=+1635.979242461" watchObservedRunningTime="2026-07-06 14:42:13.414513048 +0000 UTC m=+1635.981420672"
Jul 06 14:42:15.489732 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.489696    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"]
Jul 06 14:42:15.490164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.489925    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" podUID="5b3efde2-036f-4030-88ba-0f7c1f359df9" containerName="maas-api" containerID="cri-o://237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401" gracePeriod=30
Jul 06 14:42:15.737967 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.737941    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:15.827275 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.827244    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dfvv\" (UniqueName: \"kubernetes.io/projected/5b3efde2-036f-4030-88ba-0f7c1f359df9-kube-api-access-8dfvv\") pod \"5b3efde2-036f-4030-88ba-0f7c1f359df9\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") "
Jul 06 14:42:15.827483 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.827313    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") pod \"5b3efde2-036f-4030-88ba-0f7c1f359df9\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") "
Jul 06 14:42:15.827483 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.827364    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b3efde2-036f-4030-88ba-0f7c1f359df9-openshift-service-ca\") pod \"5b3efde2-036f-4030-88ba-0f7c1f359df9\" (UID: \"5b3efde2-036f-4030-88ba-0f7c1f359df9\") "
Jul 06 14:42:15.827745 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.827722    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b3efde2-036f-4030-88ba-0f7c1f359df9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5b3efde2-036f-4030-88ba-0f7c1f359df9" (UID: "5b3efde2-036f-4030-88ba-0f7c1f359df9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:42:15.829421 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.829397    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5b3efde2-036f-4030-88ba-0f7c1f359df9" (UID: "5b3efde2-036f-4030-88ba-0f7c1f359df9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:42:15.829521 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.829470    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b3efde2-036f-4030-88ba-0f7c1f359df9-kube-api-access-8dfvv" (OuterVolumeSpecName: "kube-api-access-8dfvv") pod "5b3efde2-036f-4030-88ba-0f7c1f359df9" (UID: "5b3efde2-036f-4030-88ba-0f7c1f359df9"). InnerVolumeSpecName "kube-api-access-8dfvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:42:15.928255 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.928219    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b3efde2-036f-4030-88ba-0f7c1f359df9-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:42:15.928255 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.928247    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b3efde2-036f-4030-88ba-0f7c1f359df9-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:42:15.928255 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:15.928258    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dfvv\" (UniqueName: \"kubernetes.io/projected/5b3efde2-036f-4030-88ba-0f7c1f359df9-kube-api-access-8dfvv\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:42:16.407623 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.407590    2581 generic.go:356] "Generic (PLEG): container finished" podID="5b3efde2-036f-4030-88ba-0f7c1f359df9" containerID="237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401" exitCode=0
Jul 06 14:42:16.407792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.407635    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"
Jul 06 14:42:16.407792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.407640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" event={"ID":"5b3efde2-036f-4030-88ba-0f7c1f359df9","Type":"ContainerDied","Data":"237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401"}
Jul 06 14:42:16.407792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.407687    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7" event={"ID":"5b3efde2-036f-4030-88ba-0f7c1f359df9","Type":"ContainerDied","Data":"78d9713a60ffed887b634bd78aef6decd70f817395c6782a4abcd18dff93b58b"}
Jul 06 14:42:16.407792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.407709    2581 scope.go:117] "RemoveContainer" containerID="237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401"
Jul 06 14:42:16.416494 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.416474    2581 scope.go:117] "RemoveContainer" containerID="237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401"
Jul 06 14:42:16.416801 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:42:16.416781    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401\": container with ID starting with 237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401 not found: ID does not exist" containerID="237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401"
Jul 06 14:42:16.416855 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.416810    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401"} err="failed to get container status \"237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401\": rpc error: code = NotFound desc = could not find container \"237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401\": container with ID starting with 237959cd23d5588c60c23b4cf50834323c6bb96856f3cc34ee7900cd61896401 not found: ID does not exist"
Jul 06 14:42:16.431473 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.431445    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"]
Jul 06 14:42:16.440806 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.440782    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-5e4b6a62-6584c85b4f-5fjl7"]
Jul 06 14:42:16.849739 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:42:16.849711    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b3efde2-036f-4030-88ba-0f7c1f359df9" path="/var/lib/kubelet/pods/5b3efde2-036f-4030-88ba-0f7c1f359df9/volumes"
Jul 06 14:43:54.474298 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:43:54.474258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:44:02.284549 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:02.284509    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:44:10.384345 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:10.384309    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:44:13.801759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.801714    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"]
Jul 06 14:44:13.802286 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.802266    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b3efde2-036f-4030-88ba-0f7c1f359df9" containerName="maas-api"
Jul 06 14:44:13.802386 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.802289    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b3efde2-036f-4030-88ba-0f7c1f359df9" containerName="maas-api"
Jul 06 14:44:13.802448 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.802397    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b3efde2-036f-4030-88ba-0f7c1f359df9" containerName="maas-api"
Jul 06 14:44:13.805853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.805832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:13.808237 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.808207    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-45508226-serving-cert\""
Jul 06 14:44:13.808404 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.808248    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:44:13.820807 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.820779    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"]
Jul 06 14:44:13.919654 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.919616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djfwk\" (UniqueName: \"kubernetes.io/projected/56b1f175-b2a4-41a9-937e-9ea9636920fe-kube-api-access-djfwk\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:13.919838 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.919687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1f175-b2a4-41a9-937e-9ea9636920fe-openshift-service-ca\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:13.919838 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:13.919717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1f175-b2a4-41a9-937e-9ea9636920fe-maas-api-tls\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.021007 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.020966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djfwk\" (UniqueName: \"kubernetes.io/projected/56b1f175-b2a4-41a9-937e-9ea9636920fe-kube-api-access-djfwk\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.021222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.021079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1f175-b2a4-41a9-937e-9ea9636920fe-openshift-service-ca\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.021222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.021135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1f175-b2a4-41a9-937e-9ea9636920fe-maas-api-tls\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.021781 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.021756    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1f175-b2a4-41a9-937e-9ea9636920fe-openshift-service-ca\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.023550 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.023528    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1f175-b2a4-41a9-937e-9ea9636920fe-maas-api-tls\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.031138 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.031113    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djfwk\" (UniqueName: \"kubernetes.io/projected/56b1f175-b2a4-41a9-937e-9ea9636920fe-kube-api-access-djfwk\") pod \"maas-api-e2e-mt-45508226-798574d996-hrnl8\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") " pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.115829 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.115731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.272125 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.272099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"]
Jul 06 14:44:14.274180 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:44:14.274151    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b1f175_b2a4_41a9_937e_9ea9636920fe.slice/crio-5bdbc436e51f92bb779e4db2e0ce6778bea42cbe8874946b577d4f208b7a5db4 WatchSource:0}: Error finding container 5bdbc436e51f92bb779e4db2e0ce6778bea42cbe8874946b577d4f208b7a5db4: Status 404 returned error can't find the container with id 5bdbc436e51f92bb779e4db2e0ce6778bea42cbe8874946b577d4f208b7a5db4
Jul 06 14:44:14.949521 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.949432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8" event={"ID":"56b1f175-b2a4-41a9-937e-9ea9636920fe","Type":"ContainerStarted","Data":"58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030"}
Jul 06 14:44:14.949521 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.949484    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8" event={"ID":"56b1f175-b2a4-41a9-937e-9ea9636920fe","Type":"ContainerStarted","Data":"5bdbc436e51f92bb779e4db2e0ce6778bea42cbe8874946b577d4f208b7a5db4"}
Jul 06 14:44:14.949521 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.949520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:14.975114 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:14.975063    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8" podStartSLOduration=1.560397467 podStartE2EDuration="1.975043447s" totalImagesPullingTime="414.64598ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:44:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:44:14.973397991 +0000 UTC m=+1757.540305629" watchObservedRunningTime="2026-07-06 14:44:14.975043447 +0000 UTC m=+1757.541951068"
Jul 06 14:44:18.677083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:18.677047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:44:20.959851 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:20.959824    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:28.058424 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.058392    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"]
Jul 06 14:44:28.058829 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.058612    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8" podUID="56b1f175-b2a4-41a9-937e-9ea9636920fe" containerName="maas-api" containerID="cri-o://58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030" gracePeriod=30
Jul 06 14:44:28.296742 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.296718    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:28.336926 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.336840    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1f175-b2a4-41a9-937e-9ea9636920fe-openshift-service-ca\") pod \"56b1f175-b2a4-41a9-937e-9ea9636920fe\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") "
Jul 06 14:44:28.336926 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.336880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1f175-b2a4-41a9-937e-9ea9636920fe-maas-api-tls\") pod \"56b1f175-b2a4-41a9-937e-9ea9636920fe\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") "
Jul 06 14:44:28.337155 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.336956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djfwk\" (UniqueName: \"kubernetes.io/projected/56b1f175-b2a4-41a9-937e-9ea9636920fe-kube-api-access-djfwk\") pod \"56b1f175-b2a4-41a9-937e-9ea9636920fe\" (UID: \"56b1f175-b2a4-41a9-937e-9ea9636920fe\") "
Jul 06 14:44:28.337246 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.337217    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56b1f175-b2a4-41a9-937e-9ea9636920fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56b1f175-b2a4-41a9-937e-9ea9636920fe" (UID: "56b1f175-b2a4-41a9-937e-9ea9636920fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:44:28.338983 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.338953    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56b1f175-b2a4-41a9-937e-9ea9636920fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56b1f175-b2a4-41a9-937e-9ea9636920fe" (UID: "56b1f175-b2a4-41a9-937e-9ea9636920fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:44:28.338983 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.338977    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56b1f175-b2a4-41a9-937e-9ea9636920fe-kube-api-access-djfwk" (OuterVolumeSpecName: "kube-api-access-djfwk") pod "56b1f175-b2a4-41a9-937e-9ea9636920fe" (UID: "56b1f175-b2a4-41a9-937e-9ea9636920fe"). InnerVolumeSpecName "kube-api-access-djfwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:44:28.437690 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.437654    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djfwk\" (UniqueName: \"kubernetes.io/projected/56b1f175-b2a4-41a9-937e-9ea9636920fe-kube-api-access-djfwk\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:44:28.437690 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.437685    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56b1f175-b2a4-41a9-937e-9ea9636920fe-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:44:28.437690 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:28.437694    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56b1f175-b2a4-41a9-937e-9ea9636920fe-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:44:29.014520 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.014487    2581 generic.go:356] "Generic (PLEG): container finished" podID="56b1f175-b2a4-41a9-937e-9ea9636920fe" containerID="58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030" exitCode=0
Jul 06 14:44:29.014710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.014532    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"
Jul 06 14:44:29.014710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.014578    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8" event={"ID":"56b1f175-b2a4-41a9-937e-9ea9636920fe","Type":"ContainerDied","Data":"58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030"}
Jul 06 14:44:29.014710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.014644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8" event={"ID":"56b1f175-b2a4-41a9-937e-9ea9636920fe","Type":"ContainerDied","Data":"5bdbc436e51f92bb779e4db2e0ce6778bea42cbe8874946b577d4f208b7a5db4"}
Jul 06 14:44:29.014710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.014676    2581 scope.go:117] "RemoveContainer" containerID="58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030"
Jul 06 14:44:29.023228 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.023215    2581 scope.go:117] "RemoveContainer" containerID="58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030"
Jul 06 14:44:29.023506 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:44:29.023484    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030\": container with ID starting with 58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030 not found: ID does not exist" containerID="58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030"
Jul 06 14:44:29.023565 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.023513    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030"} err="failed to get container status \"58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030\": rpc error: code = NotFound desc = could not find container \"58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030\": container with ID starting with 58b05267ecca042cdf342ead936cbcbebc1b5815cee1c7d711463e745f814030 not found: ID does not exist"
Jul 06 14:44:29.034316 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.034293    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"]
Jul 06 14:44:29.037811 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:29.037792    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-45508226-798574d996-hrnl8"]
Jul 06 14:44:30.850664 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:30.850634    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56b1f175-b2a4-41a9-937e-9ea9636920fe" path="/var/lib/kubelet/pods/56b1f175-b2a4-41a9-937e-9ea9636920fe/volumes"
Jul 06 14:44:33.162171 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:33.162133    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:44:58.946918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.946886    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"]
Jul 06 14:44:58.947464 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.947448    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56b1f175-b2a4-41a9-937e-9ea9636920fe" containerName="maas-api"
Jul 06 14:44:58.947524 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.947467    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="56b1f175-b2a4-41a9-937e-9ea9636920fe" containerName="maas-api"
Jul 06 14:44:58.947573 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.947561    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="56b1f175-b2a4-41a9-937e-9ea9636920fe" containerName="maas-api"
Jul 06 14:44:58.951217 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.951189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:58.955637 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.955614    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-94615ad1-serving-cert\""
Jul 06 14:44:58.955768 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.955691    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:44:58.974905 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:58.974878    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"]
Jul 06 14:44:59.127672 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.127639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x2zg\" (UniqueName: \"kubernetes.io/projected/e68f0097-9d1b-4b81-8d60-68def1ab0b09-kube-api-access-9x2zg\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.127853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.127695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f0097-9d1b-4b81-8d60-68def1ab0b09-openshift-service-ca\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.127853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.127724    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f0097-9d1b-4b81-8d60-68def1ab0b09-maas-api-tls\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.228759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.228660    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x2zg\" (UniqueName: \"kubernetes.io/projected/e68f0097-9d1b-4b81-8d60-68def1ab0b09-kube-api-access-9x2zg\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.228759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.228712    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f0097-9d1b-4b81-8d60-68def1ab0b09-openshift-service-ca\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.228759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.228735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f0097-9d1b-4b81-8d60-68def1ab0b09-maas-api-tls\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.229427 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.229406    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f0097-9d1b-4b81-8d60-68def1ab0b09-openshift-service-ca\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.231113 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.231093    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f0097-9d1b-4b81-8d60-68def1ab0b09-maas-api-tls\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.239419 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.239384    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x2zg\" (UniqueName: \"kubernetes.io/projected/e68f0097-9d1b-4b81-8d60-68def1ab0b09-kube-api-access-9x2zg\") pod \"maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") " pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.263243 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.263216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:44:59.422384 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:44:59.422323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"]
Jul 06 14:44:59.424651 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:44:59.424620    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode68f0097_9d1b_4b81_8d60_68def1ab0b09.slice/crio-f060e2b761f7784dfdbef6eb564f3402e7a6e9eeb4e3f1a79a44f7c2a1adba16 WatchSource:0}: Error finding container f060e2b761f7784dfdbef6eb564f3402e7a6e9eeb4e3f1a79a44f7c2a1adba16: Status 404 returned error can't find the container with id f060e2b761f7784dfdbef6eb564f3402e7a6e9eeb4e3f1a79a44f7c2a1adba16
Jul 06 14:45:00.165829 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:00.165738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg" event={"ID":"e68f0097-9d1b-4b81-8d60-68def1ab0b09","Type":"ContainerStarted","Data":"43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf"}
Jul 06 14:45:00.165829 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:00.165790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg" event={"ID":"e68f0097-9d1b-4b81-8d60-68def1ab0b09","Type":"ContainerStarted","Data":"f060e2b761f7784dfdbef6eb564f3402e7a6e9eeb4e3f1a79a44f7c2a1adba16"}
Jul 06 14:45:00.166262 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:00.165855    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:45:00.200068 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:00.200010    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg" podStartSLOduration=1.801207358 podStartE2EDuration="2.199987208s" totalImagesPullingTime="398.77985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:45:00.198567954 +0000 UTC m=+1802.765475579" watchObservedRunningTime="2026-07-06 14:45:00.199987208 +0000 UTC m=+1802.766894831"
Jul 06 14:45:01.789755 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:01.789719    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:45:06.175537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:06.175507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:45:09.277512 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.277479    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"]
Jul 06 14:45:09.281426 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.281403    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.287529 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.287507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-94615ad1\"/\"kube-root-ca.crt\""
Jul 06 14:45:09.288253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.288176    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-94615ad1\"/\"openshift-service-ca.crt\""
Jul 06 14:45:09.288253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.288176    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-94615ad1\"/\"e2e-lifecycle-model-94615ad1-kserve-self-signed-certs\""
Jul 06 14:45:09.288253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.288229    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-94615ad1\"/\"default-dockercfg-88p4n\""
Jul 06 14:45:09.300122 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.300099    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"]
Jul 06 14:45:09.310397 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.310365    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-home\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.310555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.310417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-model-cache\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.310555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.310458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-dshm\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.310555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.310481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-tmp-dir\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.310555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.310520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8be96e9-4af8-4992-94ed-38a91bac4137-tls-certs\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.310804 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.310566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvn5k\" (UniqueName: \"kubernetes.io/projected/c8be96e9-4af8-4992-94ed-38a91bac4137-kube-api-access-mvn5k\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-dshm\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411165 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-tmp-dir\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411436 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8be96e9-4af8-4992-94ed-38a91bac4137-tls-certs\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411436 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvn5k\" (UniqueName: \"kubernetes.io/projected/c8be96e9-4af8-4992-94ed-38a91bac4137-kube-api-access-mvn5k\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411436 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411271    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-home\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411436 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-model-cache\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411666 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411644    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-tmp-dir\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411740 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411662    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-model-cache\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.411740 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.411727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-home\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.413442 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.413421    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-dshm\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.413697 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.413682    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8be96e9-4af8-4992-94ed-38a91bac4137-tls-certs\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.421786 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.421762    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvn5k\" (UniqueName: \"kubernetes.io/projected/c8be96e9-4af8-4992-94ed-38a91bac4137-kube-api-access-mvn5k\") pod \"e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") " pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.592568 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.592482    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:09.728445 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:09.728241    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"]
Jul 06 14:45:09.731138 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:45:09.731110    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8be96e9_4af8_4992_94ed_38a91bac4137.slice/crio-e7d86b420d19fdb0c40617ac85f59f4ecce0a837822e22eada5f4dbdcaacb841 WatchSource:0}: Error finding container e7d86b420d19fdb0c40617ac85f59f4ecce0a837822e22eada5f4dbdcaacb841: Status 404 returned error can't find the container with id e7d86b420d19fdb0c40617ac85f59f4ecce0a837822e22eada5f4dbdcaacb841
Jul 06 14:45:10.211789 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:10.211751    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr" event={"ID":"c8be96e9-4af8-4992-94ed-38a91bac4137","Type":"ContainerStarted","Data":"3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2"}
Jul 06 14:45:10.211971 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:10.211798    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr" event={"ID":"c8be96e9-4af8-4992-94ed-38a91bac4137","Type":"ContainerStarted","Data":"e7d86b420d19fdb0c40617ac85f59f4ecce0a837822e22eada5f4dbdcaacb841"}
Jul 06 14:45:10.234886 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:10.234823    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr" podStartSLOduration=1.234804152 podStartE2EDuration="1.234804152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:45:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:45:10.233731701 +0000 UTC m=+1812.800639324" watchObservedRunningTime="2026-07-06 14:45:10.234804152 +0000 UTC m=+1812.801711775"
Jul 06 14:45:16.079909 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:16.079868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:45:19.593450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:19.593414    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:19.593834 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:19.593464    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:19.605874 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:19.605844    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:20.272493 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:20.272466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:28.376342 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:28.376305    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:45:32.675607 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:32.675572    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"]
Jul 06 14:45:32.676316 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:32.676262    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg" podUID="e68f0097-9d1b-4b81-8d60-68def1ab0b09" containerName="maas-api" containerID="cri-o://43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf" gracePeriod=30
Jul 06 14:45:32.933256 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:32.933194    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:45:33.037593 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.037560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f0097-9d1b-4b81-8d60-68def1ab0b09-openshift-service-ca\") pod \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") "
Jul 06 14:45:33.037761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.037662    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x2zg\" (UniqueName: \"kubernetes.io/projected/e68f0097-9d1b-4b81-8d60-68def1ab0b09-kube-api-access-9x2zg\") pod \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") "
Jul 06 14:45:33.037761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.037682    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f0097-9d1b-4b81-8d60-68def1ab0b09-maas-api-tls\") pod \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\" (UID: \"e68f0097-9d1b-4b81-8d60-68def1ab0b09\") "
Jul 06 14:45:33.037927 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.037904    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e68f0097-9d1b-4b81-8d60-68def1ab0b09-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e68f0097-9d1b-4b81-8d60-68def1ab0b09" (UID: "e68f0097-9d1b-4b81-8d60-68def1ab0b09"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:45:33.039761 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.039727    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e68f0097-9d1b-4b81-8d60-68def1ab0b09-kube-api-access-9x2zg" (OuterVolumeSpecName: "kube-api-access-9x2zg") pod "e68f0097-9d1b-4b81-8d60-68def1ab0b09" (UID: "e68f0097-9d1b-4b81-8d60-68def1ab0b09"). InnerVolumeSpecName "kube-api-access-9x2zg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:45:33.039888 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.039801    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e68f0097-9d1b-4b81-8d60-68def1ab0b09-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e68f0097-9d1b-4b81-8d60-68def1ab0b09" (UID: "e68f0097-9d1b-4b81-8d60-68def1ab0b09"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:45:33.139189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.139149    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x2zg\" (UniqueName: \"kubernetes.io/projected/e68f0097-9d1b-4b81-8d60-68def1ab0b09-kube-api-access-9x2zg\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:33.139189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.139184    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e68f0097-9d1b-4b81-8d60-68def1ab0b09-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:33.139189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.139193    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e68f0097-9d1b-4b81-8d60-68def1ab0b09-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:33.323754 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.323720    2581 generic.go:356] "Generic (PLEG): container finished" podID="e68f0097-9d1b-4b81-8d60-68def1ab0b09" containerID="43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf" exitCode=0
Jul 06 14:45:33.323929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.323764    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"
Jul 06 14:45:33.323929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.323800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg" event={"ID":"e68f0097-9d1b-4b81-8d60-68def1ab0b09","Type":"ContainerDied","Data":"43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf"}
Jul 06 14:45:33.323929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.323857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg" event={"ID":"e68f0097-9d1b-4b81-8d60-68def1ab0b09","Type":"ContainerDied","Data":"f060e2b761f7784dfdbef6eb564f3402e7a6e9eeb4e3f1a79a44f7c2a1adba16"}
Jul 06 14:45:33.323929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.323884    2581 scope.go:117] "RemoveContainer" containerID="43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf"
Jul 06 14:45:33.333058 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.333037    2581 scope.go:117] "RemoveContainer" containerID="43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf"
Jul 06 14:45:33.333346 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:45:33.333324    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf\": container with ID starting with 43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf not found: ID does not exist" containerID="43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf"
Jul 06 14:45:33.333417 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.333379    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf"} err="failed to get container status \"43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf\": rpc error: code = NotFound desc = could not find container \"43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf\": container with ID starting with 43cdca5b1856940cd6934e417f834f3d0399cd7abaab6d04ea007b1518a41fdf not found: ID does not exist"
Jul 06 14:45:33.361836 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.361793    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"]
Jul 06 14:45:33.371710 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:33.371684    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-94615ad1-7d6c4b774c-4l9wg"]
Jul 06 14:45:34.850815 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:34.850785    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e68f0097-9d1b-4b81-8d60-68def1ab0b09" path="/var/lib/kubelet/pods/e68f0097-9d1b-4b81-8d60-68def1ab0b09/volumes"
Jul 06 14:45:42.118437 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:42.118400    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"]
Jul 06 14:45:43.623913 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:43.623883    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:45:57.139161 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.139121    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr" podUID="c8be96e9-4af8-4992-94ed-38a91bac4137" containerName="main" containerID="cri-o://3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2" gracePeriod=45
Jul 06 14:45:57.397863 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.397786    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:57.439063 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.439031    2581 generic.go:356] "Generic (PLEG): container finished" podID="c8be96e9-4af8-4992-94ed-38a91bac4137" containerID="3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2" exitCode=0
Jul 06 14:45:57.439244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.439074    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"
Jul 06 14:45:57.439244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.439116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr" event={"ID":"c8be96e9-4af8-4992-94ed-38a91bac4137","Type":"ContainerDied","Data":"3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2"}
Jul 06 14:45:57.439244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.439162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr" event={"ID":"c8be96e9-4af8-4992-94ed-38a91bac4137","Type":"ContainerDied","Data":"e7d86b420d19fdb0c40617ac85f59f4ecce0a837822e22eada5f4dbdcaacb841"}
Jul 06 14:45:57.439244 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.439180    2581 scope.go:117] "RemoveContainer" containerID="3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2"
Jul 06 14:45:57.448159 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.448135    2581 scope.go:117] "RemoveContainer" containerID="3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2"
Jul 06 14:45:57.448505 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:45:57.448477    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2\": container with ID starting with 3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2 not found: ID does not exist" containerID="3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2"
Jul 06 14:45:57.448601 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.448515    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2"} err="failed to get container status \"3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2\": rpc error: code = NotFound desc = could not find container \"3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2\": container with ID starting with 3b3c86090ff061bbbc2789328dfd9a2f0313e6e4f60e5fe55a3df659b1f9ced2 not found: ID does not exist"
Jul 06 14:45:57.462903 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.462868    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvn5k\" (UniqueName: \"kubernetes.io/projected/c8be96e9-4af8-4992-94ed-38a91bac4137-kube-api-access-mvn5k\") pod \"c8be96e9-4af8-4992-94ed-38a91bac4137\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") "
Jul 06 14:45:57.463062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.462911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-tmp-dir\") pod \"c8be96e9-4af8-4992-94ed-38a91bac4137\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") "
Jul 06 14:45:57.463062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.462943    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-home\") pod \"c8be96e9-4af8-4992-94ed-38a91bac4137\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") "
Jul 06 14:45:57.463062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.462963    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-model-cache\") pod \"c8be96e9-4af8-4992-94ed-38a91bac4137\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") "
Jul 06 14:45:57.463062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463023    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-dshm\") pod \"c8be96e9-4af8-4992-94ed-38a91bac4137\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") "
Jul 06 14:45:57.463062 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463050    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8be96e9-4af8-4992-94ed-38a91bac4137-tls-certs\") pod \"c8be96e9-4af8-4992-94ed-38a91bac4137\" (UID: \"c8be96e9-4af8-4992-94ed-38a91bac4137\") "
Jul 06 14:45:57.463330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463274    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-home" (OuterVolumeSpecName: "home") pod "c8be96e9-4af8-4992-94ed-38a91bac4137" (UID: "c8be96e9-4af8-4992-94ed-38a91bac4137"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:45:57.463330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463291    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-model-cache" (OuterVolumeSpecName: "model-cache") pod "c8be96e9-4af8-4992-94ed-38a91bac4137" (UID: "c8be96e9-4af8-4992-94ed-38a91bac4137"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:45:57.463471 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463264    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c8be96e9-4af8-4992-94ed-38a91bac4137" (UID: "c8be96e9-4af8-4992-94ed-38a91bac4137"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:45:57.463471 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463461    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-tmp-dir\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:57.463560 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463480    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-home\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:57.463560 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.463495    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-model-cache\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:57.465217 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.465187    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-dshm" (OuterVolumeSpecName: "dshm") pod "c8be96e9-4af8-4992-94ed-38a91bac4137" (UID: "c8be96e9-4af8-4992-94ed-38a91bac4137"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:45:57.465330 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.465257    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8be96e9-4af8-4992-94ed-38a91bac4137-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c8be96e9-4af8-4992-94ed-38a91bac4137" (UID: "c8be96e9-4af8-4992-94ed-38a91bac4137"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:45:57.465466 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.465450    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8be96e9-4af8-4992-94ed-38a91bac4137-kube-api-access-mvn5k" (OuterVolumeSpecName: "kube-api-access-mvn5k") pod "c8be96e9-4af8-4992-94ed-38a91bac4137" (UID: "c8be96e9-4af8-4992-94ed-38a91bac4137"). InnerVolumeSpecName "kube-api-access-mvn5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:45:57.564126 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.564086    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvn5k\" (UniqueName: \"kubernetes.io/projected/c8be96e9-4af8-4992-94ed-38a91bac4137-kube-api-access-mvn5k\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:57.564126 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.564117    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8be96e9-4af8-4992-94ed-38a91bac4137-dshm\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:57.564126 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.564130    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8be96e9-4af8-4992-94ed-38a91bac4137-tls-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:45:57.762874 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.762840    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"]
Jul 06 14:45:57.768908 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:57.768879    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-94615ad1/e2e-lifecycle-model-94615ad1-kserve-5cb87d4cd7-jwkgr"]
Jul 06 14:45:58.853086 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:45:58.853050    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8be96e9-4af8-4992-94ed-38a91bac4137" path="/var/lib/kubelet/pods/c8be96e9-4af8-4992-94ed-38a91bac4137/volumes"
Jul 06 14:46:21.469742 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:46:21.469709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:46:39.446081 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:46:39.446050    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:46:55.716873 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:46:55.716840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:47:38.078108 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078076    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"]
Jul 06 14:47:38.078656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078501    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e68f0097-9d1b-4b81-8d60-68def1ab0b09" containerName="maas-api"
Jul 06 14:47:38.078656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078515    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e68f0097-9d1b-4b81-8d60-68def1ab0b09" containerName="maas-api"
Jul 06 14:47:38.078656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078526    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8be96e9-4af8-4992-94ed-38a91bac4137" containerName="main"
Jul 06 14:47:38.078656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078531    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8be96e9-4af8-4992-94ed-38a91bac4137" containerName="main"
Jul 06 14:47:38.078656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078595    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8be96e9-4af8-4992-94ed-38a91bac4137" containerName="main"
Jul 06 14:47:38.078656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.078606    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e68f0097-9d1b-4b81-8d60-68def1ab0b09" containerName="maas-api"
Jul 06 14:47:38.081688 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.081668    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.085030 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.085007    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-17d239-serving-cert\""
Jul 06 14:47:38.085178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.085159    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:47:38.104687 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.104658    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"]
Jul 06 14:47:38.182874 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.182838    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/164a1f82-6613-4f62-b4cc-279ef74ea910-openshift-service-ca\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.183049 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.182897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4tnx\" (UniqueName: \"kubernetes.io/projected/164a1f82-6613-4f62-b4cc-279ef74ea910-kube-api-access-z4tnx\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.183049 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.182943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.284251 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.284214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/164a1f82-6613-4f62-b4cc-279ef74ea910-openshift-service-ca\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.284452 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.284270    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4tnx\" (UniqueName: \"kubernetes.io/projected/164a1f82-6613-4f62-b4cc-279ef74ea910-kube-api-access-z4tnx\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.284452 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.284304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.284537 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:47:38.284457    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-17d239-serving-cert: secret "maas-api-e2e-inf-a-17d239-serving-cert" not found
Jul 06 14:47:38.284573 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:47:38.284536    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls podName:164a1f82-6613-4f62-b4cc-279ef74ea910 nodeName:}" failed. No retries permitted until 2026-07-06 14:47:38.784513891 +0000 UTC m=+1961.351421495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls") pod "maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" (UID: "164a1f82-6613-4f62-b4cc-279ef74ea910") : secret "maas-api-e2e-inf-a-17d239-serving-cert" not found
Jul 06 14:47:38.284951 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.284929    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/164a1f82-6613-4f62-b4cc-279ef74ea910-openshift-service-ca\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.300446 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.300409    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4tnx\" (UniqueName: \"kubernetes.io/projected/164a1f82-6613-4f62-b4cc-279ef74ea910-kube-api-access-z4tnx\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.788622 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.788579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.791050 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.791024    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls\") pod \"maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") " pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:38.991924 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:38.991887    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:39.136566 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:39.136540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"]
Jul 06 14:47:39.138628 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:47:39.138601    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod164a1f82_6613_4f62_b4cc_279ef74ea910.slice/crio-c920db0ef6fe72c4febd183adcdb7de204cf2fbe81b8e89ed7cb4855ebd0c3b8 WatchSource:0}: Error finding container c920db0ef6fe72c4febd183adcdb7de204cf2fbe81b8e89ed7cb4855ebd0c3b8: Status 404 returned error can't find the container with id c920db0ef6fe72c4febd183adcdb7de204cf2fbe81b8e89ed7cb4855ebd0c3b8
Jul 06 14:47:39.140305 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:39.140290    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:47:39.925163 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:39.925069    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" event={"ID":"164a1f82-6613-4f62-b4cc-279ef74ea910","Type":"ContainerStarted","Data":"054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229"}
Jul 06 14:47:39.925163 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:39.925125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" event={"ID":"164a1f82-6613-4f62-b4cc-279ef74ea910","Type":"ContainerStarted","Data":"c920db0ef6fe72c4febd183adcdb7de204cf2fbe81b8e89ed7cb4855ebd0c3b8"}
Jul 06 14:47:39.925431 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:39.925189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:39.964066 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:39.964016    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" podStartSLOduration=1.464086297 podStartE2EDuration="1.963999633s" totalImagesPullingTime="499.913336ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:47:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:47:39.960536377 +0000 UTC m=+1962.527443997" watchObservedRunningTime="2026-07-06 14:47:39.963999633 +0000 UTC m=+1962.530907254"
Jul 06 14:47:42.513196 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:42.513163    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:47:45.934954 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:45.934929    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:47:47.393194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.393161    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"]
Jul 06 14:47:47.397406 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.397383    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.405134 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.405114    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-2bc2ad-serving-cert\""
Jul 06 14:47:47.430865 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.430839    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"]
Jul 06 14:47:47.573894 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.573853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.574089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.573928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt6x9\" (UniqueName: \"kubernetes.io/projected/d6ea4318-a7ce-48ec-ba43-787636fe2134-kube-api-access-vt6x9\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.574089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.573970    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ea4318-a7ce-48ec-ba43-787636fe2134-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.675134 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.675035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.675134 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.675098    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt6x9\" (UniqueName: \"kubernetes.io/projected/d6ea4318-a7ce-48ec-ba43-787636fe2134-kube-api-access-vt6x9\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.675397 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.675139    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ea4318-a7ce-48ec-ba43-787636fe2134-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.675397 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:47:47.675217    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-2bc2ad-serving-cert: secret "maas-api-e2e-inf-b-2bc2ad-serving-cert" not found
Jul 06 14:47:47.675397 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:47:47.675297    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls podName:d6ea4318-a7ce-48ec-ba43-787636fe2134 nodeName:}" failed. No retries permitted until 2026-07-06 14:47:48.175273767 +0000 UTC m=+1970.742181369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls") pod "maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" (UID: "d6ea4318-a7ce-48ec-ba43-787636fe2134") : secret "maas-api-e2e-inf-b-2bc2ad-serving-cert" not found
Jul 06 14:47:47.675880 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.675858    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ea4318-a7ce-48ec-ba43-787636fe2134-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:47.688953 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:47.688920    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt6x9\" (UniqueName: \"kubernetes.io/projected/d6ea4318-a7ce-48ec-ba43-787636fe2134-kube-api-access-vt6x9\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:48.179373 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.179317    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:48.181898 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.181875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls\") pod \"maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") " pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:48.307536 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.307502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:48.456171 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.456094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"]
Jul 06 14:47:48.459408 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:47:48.459347    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ea4318_a7ce_48ec_ba43_787636fe2134.slice/crio-4be63026a21a76a1190ab208a419324de5b0b37e6fc862fddfb56acb6166110a WatchSource:0}: Error finding container 4be63026a21a76a1190ab208a419324de5b0b37e6fc862fddfb56acb6166110a: Status 404 returned error can't find the container with id 4be63026a21a76a1190ab208a419324de5b0b37e6fc862fddfb56acb6166110a
Jul 06 14:47:48.970879 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.970843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" event={"ID":"d6ea4318-a7ce-48ec-ba43-787636fe2134","Type":"ContainerStarted","Data":"23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520"}
Jul 06 14:47:48.971049 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.970896    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" event={"ID":"d6ea4318-a7ce-48ec-ba43-787636fe2134","Type":"ContainerStarted","Data":"4be63026a21a76a1190ab208a419324de5b0b37e6fc862fddfb56acb6166110a"}
Jul 06 14:47:48.971049 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.970940    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:47:48.995441 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:48.995393    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" podStartSLOduration=1.675234168 podStartE2EDuration="1.995374836s" totalImagesPullingTime="320.140668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:47:48.99351921 +0000 UTC m=+1971.560426832" watchObservedRunningTime="2026-07-06 14:47:48.995374836 +0000 UTC m=+1971.562282448"
Jul 06 14:47:54.980807 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:47:54.980732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:48:00.273046 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:00.273011    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:48:07.979473 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.979441    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"]
Jul 06 14:48:07.983088 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.983069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:07.986179 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.986158    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-17d239\"/\"openshift-service-ca.crt\""
Jul 06 14:48:07.986340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.986329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-17d239\"/\"default-dockercfg-ld8j5\""
Jul 06 14:48:07.987016 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.987001    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-17d239\"/\"test-model-17d239-kserve-self-signed-certs\""
Jul 06 14:48:07.987075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.987032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-17d239\"/\"kube-root-ca.crt\""
Jul 06 14:48:07.996500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:07.996476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"]
Jul 06 14:48:08.070592 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.070559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbce2304-ff3b-42e6-a86a-4b10748eed36-tls-certs\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.070592 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.070590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-tmp-dir\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.070834 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.070625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-dshm\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.070834 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.070733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-model-cache\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.070834 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.070775    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-home\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.070996 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.070906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds48c\" (UniqueName: \"kubernetes.io/projected/bbce2304-ff3b-42e6-a86a-4b10748eed36-kube-api-access-ds48c\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.171934 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.171897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-dshm\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.171955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-model-cache\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.171994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-home\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.172039    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds48c\" (UniqueName: \"kubernetes.io/projected/bbce2304-ff3b-42e6-a86a-4b10748eed36-kube-api-access-ds48c\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.172079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbce2304-ff3b-42e6-a86a-4b10748eed36-tls-certs\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172144 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.172095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-tmp-dir\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172469 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.172443    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-model-cache\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172531 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.172484    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-home\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.172531 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.172509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-tmp-dir\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.174202 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.174183    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-dshm\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.174672 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.174651    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbce2304-ff3b-42e6-a86a-4b10748eed36-tls-certs\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.182872 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.182847    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds48c\" (UniqueName: \"kubernetes.io/projected/bbce2304-ff3b-42e6-a86a-4b10748eed36-kube-api-access-ds48c\") pod \"test-model-17d239-kserve-6bc6c7bf45-bm9m8\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") " pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.292767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.292726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:08.434996 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:08.434972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"]
Jul 06 14:48:08.436579 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:48:08.436549    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbce2304_ff3b_42e6_a86a_4b10748eed36.slice/crio-86a80efbdb33e8a65873fdf0d18b86357e625376b39dd6278d9eb82845a570d1 WatchSource:0}: Error finding container 86a80efbdb33e8a65873fdf0d18b86357e625376b39dd6278d9eb82845a570d1: Status 404 returned error can't find the container with id 86a80efbdb33e8a65873fdf0d18b86357e625376b39dd6278d9eb82845a570d1
Jul 06 14:48:09.064691 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:09.064656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8" event={"ID":"bbce2304-ff3b-42e6-a86a-4b10748eed36","Type":"ContainerStarted","Data":"d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb"}
Jul 06 14:48:09.064691 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:09.064694    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8" event={"ID":"bbce2304-ff3b-42e6-a86a-4b10748eed36","Type":"ContainerStarted","Data":"86a80efbdb33e8a65873fdf0d18b86357e625376b39dd6278d9eb82845a570d1"}
Jul 06 14:48:09.089884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:09.089837    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8" podStartSLOduration=2.089821066 podStartE2EDuration="2.089821066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:48:09.088239422 +0000 UTC m=+1991.655147044" watchObservedRunningTime="2026-07-06 14:48:09.089821066 +0000 UTC m=+1991.656728665"
Jul 06 14:48:12.372877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:12.372840    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:48:18.293116 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:18.293076    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:18.293634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:18.293149    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:18.306075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:18.306051    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:19.123608 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:19.123575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:48:22.064846 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:22.064814    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:48:33.384117 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.384083    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"]
Jul 06 14:48:33.388056 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.388038    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.391340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.391315    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2bc2ad\"/\"default-dockercfg-cch6t\""
Jul 06 14:48:33.391500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.391320    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2bc2ad\"/\"kube-root-ca.crt\""
Jul 06 14:48:33.391500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.391362    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2bc2ad\"/\"test-model-2bc2ad-kserve-self-signed-certs\""
Jul 06 14:48:33.391500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.391364    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2bc2ad\"/\"openshift-service-ca.crt\""
Jul 06 14:48:33.401041 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.401017    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"]
Jul 06 14:48:33.408347 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.408324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tmp-dir\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.408488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.408373    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-dshm\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.408488 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.408446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-home\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.408610 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.408535    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4btrt\" (UniqueName: \"kubernetes.io/projected/add8d57d-7db4-45e9-a920-8b8f6c7669ba-kube-api-access-4btrt\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.408610 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.408577    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-model-cache\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.408610 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.408591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tls-certs\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.509645 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.509613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-model-cache\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.509645 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.509645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tls-certs\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.509845 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.509703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tmp-dir\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.509845 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.509722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-dshm\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.509845 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.509740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-home\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.509845 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.509804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btrt\" (UniqueName: \"kubernetes.io/projected/add8d57d-7db4-45e9-a920-8b8f6c7669ba-kube-api-access-4btrt\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.510095 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.510069    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-model-cache\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.510155 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.510082    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tmp-dir\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.510221 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.510196    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-home\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.511964 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.511942    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-dshm\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.512225 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.512209    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tls-certs\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.520962 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.520941    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4btrt\" (UniqueName: \"kubernetes.io/projected/add8d57d-7db4-45e9-a920-8b8f6c7669ba-kube-api-access-4btrt\") pod \"test-model-2bc2ad-kserve-6c45664fd9-fw8s6\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") " pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.698036 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.697944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:33.841245 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:33.841223    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"]
Jul 06 14:48:33.843931 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:48:33.843903    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podadd8d57d_7db4_45e9_a920_8b8f6c7669ba.slice/crio-e4b1e33010139b8b8880a2f88941fb07a902892e8a2a89acbd234cf6167812ec WatchSource:0}: Error finding container e4b1e33010139b8b8880a2f88941fb07a902892e8a2a89acbd234cf6167812ec: Status 404 returned error can't find the container with id e4b1e33010139b8b8880a2f88941fb07a902892e8a2a89acbd234cf6167812ec
Jul 06 14:48:34.187272 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:34.187233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6" event={"ID":"add8d57d-7db4-45e9-a920-8b8f6c7669ba","Type":"ContainerStarted","Data":"e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b"}
Jul 06 14:48:34.187476 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:34.187279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6" event={"ID":"add8d57d-7db4-45e9-a920-8b8f6c7669ba","Type":"ContainerStarted","Data":"e4b1e33010139b8b8880a2f88941fb07a902892e8a2a89acbd234cf6167812ec"}
Jul 06 14:48:34.212276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:34.212227    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6" podStartSLOduration=1.212212189 podStartE2EDuration="1.212212189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:48:34.210330121 +0000 UTC m=+2016.777237779" watchObservedRunningTime="2026-07-06 14:48:34.212212189 +0000 UTC m=+2016.779119810"
Jul 06 14:48:39.184503 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:39.184468    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:48:43.698721 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:43.698686    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:43.699178 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:43.698993    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:43.711369 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:43.711334    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:44.254496 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:44.254466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:48:55.466736 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:55.466699    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"]
Jul 06 14:48:56.590283 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:56.590252    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"]
Jul 06 14:48:57.801413 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:57.801380    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"]
Jul 06 14:48:57.801868 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:57.801579    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" podUID="164a1f82-6613-4f62-b4cc-279ef74ea910" containerName="maas-api" containerID="cri-o://054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229" gracePeriod=30
Jul 06 14:48:58.068585 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.068526    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:48:58.163048 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.163021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4tnx\" (UniqueName: \"kubernetes.io/projected/164a1f82-6613-4f62-b4cc-279ef74ea910-kube-api-access-z4tnx\") pod \"164a1f82-6613-4f62-b4cc-279ef74ea910\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") "
Jul 06 14:48:58.163236 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.163103    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/164a1f82-6613-4f62-b4cc-279ef74ea910-openshift-service-ca\") pod \"164a1f82-6613-4f62-b4cc-279ef74ea910\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") "
Jul 06 14:48:58.163236 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.163143    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls\") pod \"164a1f82-6613-4f62-b4cc-279ef74ea910\" (UID: \"164a1f82-6613-4f62-b4cc-279ef74ea910\") "
Jul 06 14:48:58.163482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.163459    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/164a1f82-6613-4f62-b4cc-279ef74ea910-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "164a1f82-6613-4f62-b4cc-279ef74ea910" (UID: "164a1f82-6613-4f62-b4cc-279ef74ea910"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:48:58.165141 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.165120    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164a1f82-6613-4f62-b4cc-279ef74ea910-kube-api-access-z4tnx" (OuterVolumeSpecName: "kube-api-access-z4tnx") pod "164a1f82-6613-4f62-b4cc-279ef74ea910" (UID: "164a1f82-6613-4f62-b4cc-279ef74ea910"). InnerVolumeSpecName "kube-api-access-z4tnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:48:58.165222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.165206    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "164a1f82-6613-4f62-b4cc-279ef74ea910" (UID: "164a1f82-6613-4f62-b4cc-279ef74ea910"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:48:58.264782 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.264746    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/164a1f82-6613-4f62-b4cc-279ef74ea910-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:48:58.264782 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.264774    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4tnx\" (UniqueName: \"kubernetes.io/projected/164a1f82-6613-4f62-b4cc-279ef74ea910-kube-api-access-z4tnx\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:48:58.264782 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.264788    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/164a1f82-6613-4f62-b4cc-279ef74ea910-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:48:58.315929 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.315898    2581 generic.go:356] "Generic (PLEG): container finished" podID="164a1f82-6613-4f62-b4cc-279ef74ea910" containerID="054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229" exitCode=0
Jul 06 14:48:58.316086 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.315945    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"
Jul 06 14:48:58.316086 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.315953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" event={"ID":"164a1f82-6613-4f62-b4cc-279ef74ea910","Type":"ContainerDied","Data":"054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229"}
Jul 06 14:48:58.316086 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.315998    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv" event={"ID":"164a1f82-6613-4f62-b4cc-279ef74ea910","Type":"ContainerDied","Data":"c920db0ef6fe72c4febd183adcdb7de204cf2fbe81b8e89ed7cb4855ebd0c3b8"}
Jul 06 14:48:58.316086 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.316025    2581 scope.go:117] "RemoveContainer" containerID="054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229"
Jul 06 14:48:58.326207 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.326189    2581 scope.go:117] "RemoveContainer" containerID="054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229"
Jul 06 14:48:58.326459 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:48:58.326436    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229\": container with ID starting with 054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229 not found: ID does not exist" containerID="054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229"
Jul 06 14:48:58.326523 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.326466    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229"} err="failed to get container status \"054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229\": rpc error: code = NotFound desc = could not find container \"054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229\": container with ID starting with 054c7193fb4a20583e5d3d08f1a425690eb2f4146891737a152a10a6d6379229 not found: ID does not exist"
Jul 06 14:48:58.373470 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.373445    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"]
Jul 06 14:48:58.375455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.375429    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-17d239-7fbc7d8474-5fjkv"]
Jul 06 14:48:58.851648 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:48:58.851621    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164a1f82-6613-4f62-b4cc-279ef74ea910" path="/var/lib/kubelet/pods/164a1f82-6613-4f62-b4cc-279ef74ea910/volumes"
Jul 06 14:49:01.184927 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:01.184893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:49:10.486636 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.486589    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8" podUID="bbce2304-ff3b-42e6-a86a-4b10748eed36" containerName="main" containerID="cri-o://d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb" gracePeriod=45
Jul 06 14:49:10.739750 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.739693    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:49:10.782703 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782673    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-tmp-dir\") pod \"bbce2304-ff3b-42e6-a86a-4b10748eed36\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") "
Jul 06 14:49:10.782870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-home\") pod \"bbce2304-ff3b-42e6-a86a-4b10748eed36\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") "
Jul 06 14:49:10.782870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782780    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbce2304-ff3b-42e6-a86a-4b10748eed36-tls-certs\") pod \"bbce2304-ff3b-42e6-a86a-4b10748eed36\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") "
Jul 06 14:49:10.782870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782794    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-dshm\") pod \"bbce2304-ff3b-42e6-a86a-4b10748eed36\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") "
Jul 06 14:49:10.782870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782827    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-model-cache\") pod \"bbce2304-ff3b-42e6-a86a-4b10748eed36\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") "
Jul 06 14:49:10.782870 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782853    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ds48c\" (UniqueName: \"kubernetes.io/projected/bbce2304-ff3b-42e6-a86a-4b10748eed36-kube-api-access-ds48c\") pod \"bbce2304-ff3b-42e6-a86a-4b10748eed36\" (UID: \"bbce2304-ff3b-42e6-a86a-4b10748eed36\") "
Jul 06 14:49:10.783132 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.782965    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bbce2304-ff3b-42e6-a86a-4b10748eed36" (UID: "bbce2304-ff3b-42e6-a86a-4b10748eed36"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:10.783132 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.783050    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-home" (OuterVolumeSpecName: "home") pod "bbce2304-ff3b-42e6-a86a-4b10748eed36" (UID: "bbce2304-ff3b-42e6-a86a-4b10748eed36"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:10.783132 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.783081    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-model-cache" (OuterVolumeSpecName: "model-cache") pod "bbce2304-ff3b-42e6-a86a-4b10748eed36" (UID: "bbce2304-ff3b-42e6-a86a-4b10748eed36"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:10.783298 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.783220    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-tmp-dir\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:10.783298 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.783236    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-home\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:10.783298 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.783248    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-model-cache\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:10.785092 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.785062    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbce2304-ff3b-42e6-a86a-4b10748eed36-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bbce2304-ff3b-42e6-a86a-4b10748eed36" (UID: "bbce2304-ff3b-42e6-a86a-4b10748eed36"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:49:10.785203 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.785119    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbce2304-ff3b-42e6-a86a-4b10748eed36-kube-api-access-ds48c" (OuterVolumeSpecName: "kube-api-access-ds48c") pod "bbce2304-ff3b-42e6-a86a-4b10748eed36" (UID: "bbce2304-ff3b-42e6-a86a-4b10748eed36"). InnerVolumeSpecName "kube-api-access-ds48c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:10.785203 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.785140    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-dshm" (OuterVolumeSpecName: "dshm") pod "bbce2304-ff3b-42e6-a86a-4b10748eed36" (UID: "bbce2304-ff3b-42e6-a86a-4b10748eed36"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:10.884342 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.884308    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ds48c\" (UniqueName: \"kubernetes.io/projected/bbce2304-ff3b-42e6-a86a-4b10748eed36-kube-api-access-ds48c\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:10.884342 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.884333    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbce2304-ff3b-42e6-a86a-4b10748eed36-tls-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:10.884535 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:10.884348    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbce2304-ff3b-42e6-a86a-4b10748eed36-dshm\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:11.380037 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.380005    2581 generic.go:356] "Generic (PLEG): container finished" podID="bbce2304-ff3b-42e6-a86a-4b10748eed36" containerID="d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb" exitCode=0
Jul 06 14:49:11.380222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.380048    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8" event={"ID":"bbce2304-ff3b-42e6-a86a-4b10748eed36","Type":"ContainerDied","Data":"d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb"}
Jul 06 14:49:11.380222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.380077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8" event={"ID":"bbce2304-ff3b-42e6-a86a-4b10748eed36","Type":"ContainerDied","Data":"86a80efbdb33e8a65873fdf0d18b86357e625376b39dd6278d9eb82845a570d1"}
Jul 06 14:49:11.380222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.380092    2581 scope.go:117] "RemoveContainer" containerID="d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb"
Jul 06 14:49:11.380222 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.380052    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"
Jul 06 14:49:11.395368 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.395335    2581 scope.go:117] "RemoveContainer" containerID="d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb"
Jul 06 14:49:11.395616 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:49:11.395597    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb\": container with ID starting with d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb not found: ID does not exist" containerID="d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb"
Jul 06 14:49:11.395663 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.395623    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb"} err="failed to get container status \"d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb\": rpc error: code = NotFound desc = could not find container \"d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb\": container with ID starting with d796151098727307ac6e0fbfaea230e9b11ac8778a96bec9514129b9e711ffcb not found: ID does not exist"
Jul 06 14:49:11.406450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.406274    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"]
Jul 06 14:49:11.407975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.407957    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-17d239/test-model-17d239-kserve-6bc6c7bf45-bm9m8"]
Jul 06 14:49:11.610392 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.610328    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6" podUID="add8d57d-7db4-45e9-a920-8b8f6c7669ba" containerName="main" containerID="cri-o://e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b" gracePeriod=45
Jul 06 14:49:11.869389 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.869347    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:49:11.994189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994112    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-home\") pod \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") "
Jul 06 14:49:11.994189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994154    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-dshm\") pod \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") "
Jul 06 14:49:11.994189 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994183    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tmp-dir\") pod \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") "
Jul 06 14:49:11.994482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994210    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-model-cache\") pod \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") "
Jul 06 14:49:11.994482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994259    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4btrt\" (UniqueName: \"kubernetes.io/projected/add8d57d-7db4-45e9-a920-8b8f6c7669ba-kube-api-access-4btrt\") pod \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") "
Jul 06 14:49:11.994482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994293    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tls-certs\") pod \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\" (UID: \"add8d57d-7db4-45e9-a920-8b8f6c7669ba\") "
Jul 06 14:49:11.994482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994390    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-home" (OuterVolumeSpecName: "home") pod "add8d57d-7db4-45e9-a920-8b8f6c7669ba" (UID: "add8d57d-7db4-45e9-a920-8b8f6c7669ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:11.994686 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994500    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "add8d57d-7db4-45e9-a920-8b8f6c7669ba" (UID: "add8d57d-7db4-45e9-a920-8b8f6c7669ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:11.994686 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994514    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "add8d57d-7db4-45e9-a920-8b8f6c7669ba" (UID: "add8d57d-7db4-45e9-a920-8b8f6c7669ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:11.994686 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994653    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-home\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:11.994791 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994693    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tmp-dir\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:11.994791 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.994708    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-model-cache\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:11.996404 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.996312    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-dshm" (OuterVolumeSpecName: "dshm") pod "add8d57d-7db4-45e9-a920-8b8f6c7669ba" (UID: "add8d57d-7db4-45e9-a920-8b8f6c7669ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:49:11.996514 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.996431    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/add8d57d-7db4-45e9-a920-8b8f6c7669ba-kube-api-access-4btrt" (OuterVolumeSpecName: "kube-api-access-4btrt") pod "add8d57d-7db4-45e9-a920-8b8f6c7669ba" (UID: "add8d57d-7db4-45e9-a920-8b8f6c7669ba"). InnerVolumeSpecName "kube-api-access-4btrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:11.996514 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:11.996498    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "add8d57d-7db4-45e9-a920-8b8f6c7669ba" (UID: "add8d57d-7db4-45e9-a920-8b8f6c7669ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:49:12.096149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.096113    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/add8d57d-7db4-45e9-a920-8b8f6c7669ba-dshm\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:12.096149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.096144    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4btrt\" (UniqueName: \"kubernetes.io/projected/add8d57d-7db4-45e9-a920-8b8f6c7669ba-kube-api-access-4btrt\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:12.096149 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.096155    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/add8d57d-7db4-45e9-a920-8b8f6c7669ba-tls-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:12.386612 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.386580    2581 generic.go:356] "Generic (PLEG): container finished" podID="add8d57d-7db4-45e9-a920-8b8f6c7669ba" containerID="e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b" exitCode=0
Jul 06 14:49:12.386793 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.386630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"
Jul 06 14:49:12.386793 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.386665    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6" event={"ID":"add8d57d-7db4-45e9-a920-8b8f6c7669ba","Type":"ContainerDied","Data":"e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b"}
Jul 06 14:49:12.386793 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.386699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6" event={"ID":"add8d57d-7db4-45e9-a920-8b8f6c7669ba","Type":"ContainerDied","Data":"e4b1e33010139b8b8880a2f88941fb07a902892e8a2a89acbd234cf6167812ec"}
Jul 06 14:49:12.386793 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.386717    2581 scope.go:117] "RemoveContainer" containerID="e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b"
Jul 06 14:49:12.395571 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.395554    2581 scope.go:117] "RemoveContainer" containerID="e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b"
Jul 06 14:49:12.395819 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:49:12.395799    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b\": container with ID starting with e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b not found: ID does not exist" containerID="e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b"
Jul 06 14:49:12.395888 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.395825    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b"} err="failed to get container status \"e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b\": rpc error: code = NotFound desc = could not find container \"e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b\": container with ID starting with e58d8961f03b38aa534972faaf2ceb5fe14fc6526ea2dc9f6ec2d0c5020bcf2b not found: ID does not exist"
Jul 06 14:49:12.410632 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.410606    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"]
Jul 06 14:49:12.418321 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.418296    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2bc2ad/test-model-2bc2ad-kserve-6c45664fd9-fw8s6"]
Jul 06 14:49:12.851272 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.851240    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="add8d57d-7db4-45e9-a920-8b8f6c7669ba" path="/var/lib/kubelet/pods/add8d57d-7db4-45e9-a920-8b8f6c7669ba/volumes"
Jul 06 14:49:12.851719 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:12.851692    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbce2304-ff3b-42e6-a86a-4b10748eed36" path="/var/lib/kubelet/pods/bbce2304-ff3b-42e6-a86a-4b10748eed36/volumes"
Jul 06 14:49:42.770753 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:42.770722    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"]
Jul 06 14:49:42.771264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:42.770906    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" podUID="d6ea4318-a7ce-48ec-ba43-787636fe2134" containerName="maas-api" containerID="cri-o://23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520" gracePeriod=30
Jul 06 14:49:43.014093 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.014069    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:49:43.085492 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.085402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls\") pod \"d6ea4318-a7ce-48ec-ba43-787636fe2134\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") "
Jul 06 14:49:43.085492 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.085443    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ea4318-a7ce-48ec-ba43-787636fe2134-openshift-service-ca\") pod \"d6ea4318-a7ce-48ec-ba43-787636fe2134\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") "
Jul 06 14:49:43.085732 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.085534    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vt6x9\" (UniqueName: \"kubernetes.io/projected/d6ea4318-a7ce-48ec-ba43-787636fe2134-kube-api-access-vt6x9\") pod \"d6ea4318-a7ce-48ec-ba43-787636fe2134\" (UID: \"d6ea4318-a7ce-48ec-ba43-787636fe2134\") "
Jul 06 14:49:43.085946 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.085914    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6ea4318-a7ce-48ec-ba43-787636fe2134-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d6ea4318-a7ce-48ec-ba43-787636fe2134" (UID: "d6ea4318-a7ce-48ec-ba43-787636fe2134"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:49:43.087763 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.087732    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d6ea4318-a7ce-48ec-ba43-787636fe2134" (UID: "d6ea4318-a7ce-48ec-ba43-787636fe2134"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:49:43.087872 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.087791    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6ea4318-a7ce-48ec-ba43-787636fe2134-kube-api-access-vt6x9" (OuterVolumeSpecName: "kube-api-access-vt6x9") pod "d6ea4318-a7ce-48ec-ba43-787636fe2134" (UID: "d6ea4318-a7ce-48ec-ba43-787636fe2134"). InnerVolumeSpecName "kube-api-access-vt6x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:49:43.186994 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.186962    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vt6x9\" (UniqueName: \"kubernetes.io/projected/d6ea4318-a7ce-48ec-ba43-787636fe2134-kube-api-access-vt6x9\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:43.186994 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.186991    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d6ea4318-a7ce-48ec-ba43-787636fe2134-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:43.186994 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.187003    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6ea4318-a7ce-48ec-ba43-787636fe2134-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:49:43.540278 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.540236    2581 generic.go:356] "Generic (PLEG): container finished" podID="d6ea4318-a7ce-48ec-ba43-787636fe2134" containerID="23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520" exitCode=0
Jul 06 14:49:43.540477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.540297    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"
Jul 06 14:49:43.540477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.540308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" event={"ID":"d6ea4318-a7ce-48ec-ba43-787636fe2134","Type":"ContainerDied","Data":"23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520"}
Jul 06 14:49:43.540477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.540412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h" event={"ID":"d6ea4318-a7ce-48ec-ba43-787636fe2134","Type":"ContainerDied","Data":"4be63026a21a76a1190ab208a419324de5b0b37e6fc862fddfb56acb6166110a"}
Jul 06 14:49:43.540477 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.540441    2581 scope.go:117] "RemoveContainer" containerID="23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520"
Jul 06 14:49:43.549970 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.549952    2581 scope.go:117] "RemoveContainer" containerID="23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520"
Jul 06 14:49:43.550240 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:49:43.550219    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520\": container with ID starting with 23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520 not found: ID does not exist" containerID="23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520"
Jul 06 14:49:43.550290 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.550248    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520"} err="failed to get container status \"23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520\": rpc error: code = NotFound desc = could not find container \"23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520\": container with ID starting with 23282208c80121c27f08acae6597fd11861816f759b9299d73b0f9bbaa2a8520 not found: ID does not exist"
Jul 06 14:49:43.566884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.566854    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"]
Jul 06 14:49:43.668930 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:43.668899    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-2bc2ad-5999dc8869-rfh4h"]
Jul 06 14:49:44.851427 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:44.851398    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6ea4318-a7ce-48ec-ba43-787636fe2134" path="/var/lib/kubelet/pods/d6ea4318-a7ce-48ec-ba43-787636fe2134/volumes"
Jul 06 14:49:45.509460 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:45.509424    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:49:54.929097 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.929062    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"]
Jul 06 14:49:54.930578 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.930555    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="164a1f82-6613-4f62-b4cc-279ef74ea910" containerName="maas-api"
Jul 06 14:49:54.930709 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.930699    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="164a1f82-6613-4f62-b4cc-279ef74ea910" containerName="maas-api"
Jul 06 14:49:54.930877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.930866    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ea4318-a7ce-48ec-ba43-787636fe2134" containerName="maas-api"
Jul 06 14:49:54.930994 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.930984    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ea4318-a7ce-48ec-ba43-787636fe2134" containerName="maas-api"
Jul 06 14:49:54.931081 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931072    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbce2304-ff3b-42e6-a86a-4b10748eed36" containerName="main"
Jul 06 14:49:54.931150 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931142    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbce2304-ff3b-42e6-a86a-4b10748eed36" containerName="main"
Jul 06 14:49:54.931247 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931238    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="add8d57d-7db4-45e9-a920-8b8f6c7669ba" containerName="main"
Jul 06 14:49:54.931316 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931308    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="add8d57d-7db4-45e9-a920-8b8f6c7669ba" containerName="main"
Jul 06 14:49:54.931592 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931581    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbce2304-ff3b-42e6-a86a-4b10748eed36" containerName="main"
Jul 06 14:49:54.931692 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931683    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="add8d57d-7db4-45e9-a920-8b8f6c7669ba" containerName="main"
Jul 06 14:49:54.931772 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931763    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ea4318-a7ce-48ec-ba43-787636fe2134" containerName="maas-api"
Jul 06 14:49:54.931855 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.931846    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="164a1f82-6613-4f62-b4cc-279ef74ea910" containerName="maas-api"
Jul 06 14:49:54.939185 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.938545    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:54.946737 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.946717    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:49:54.952131 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.952113    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-a89965-serving-cert\""
Jul 06 14:49:54.966559 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.966530    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"]
Jul 06 14:49:54.989297 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.989267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-openshift-service-ca\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:54.989463 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.989309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l7lp\" (UniqueName: \"kubernetes.io/projected/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-kube-api-access-8l7lp\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:54.989508 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:54.989467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.090957 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.090921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-openshift-service-ca\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.091127 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.090962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l7lp\" (UniqueName: \"kubernetes.io/projected/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-kube-api-access-8l7lp\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.091127 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.091031    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.091209 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:49:55.091150    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-a89965-serving-cert: secret "maas-api-e2e-api-a-a89965-serving-cert" not found
Jul 06 14:49:55.091251 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:49:55.091235    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls podName:3f5f5f8b-f5b9-4826-b8fc-349dcd055355 nodeName:}" failed. No retries permitted until 2026-07-06 14:49:55.591211989 +0000 UTC m=+2098.158119590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls") pod "maas-api-e2e-api-a-a89965-6796c75bcc-8484b" (UID: "3f5f5f8b-f5b9-4826-b8fc-349dcd055355") : secret "maas-api-e2e-api-a-a89965-serving-cert" not found
Jul 06 14:49:55.091736 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.091718    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-openshift-service-ca\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.106944 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.106914    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l7lp\" (UniqueName: \"kubernetes.io/projected/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-kube-api-access-8l7lp\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.595916 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.595885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.598415 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.598392    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls\") pod \"maas-api-e2e-api-a-a89965-6796c75bcc-8484b\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") " pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:55.850732 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:55.850643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:56.001402 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:56.001379    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"]
Jul 06 14:49:56.004041 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:49:56.004020    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f5f5f8b_f5b9_4826_b8fc_349dcd055355.slice/crio-8ec29dc94a3828a9a4e0f2ecc81365a786ed946782328b71deba24a968370c17 WatchSource:0}: Error finding container 8ec29dc94a3828a9a4e0f2ecc81365a786ed946782328b71deba24a968370c17: Status 404 returned error can't find the container with id 8ec29dc94a3828a9a4e0f2ecc81365a786ed946782328b71deba24a968370c17
Jul 06 14:49:56.606231 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:56.606197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b" event={"ID":"3f5f5f8b-f5b9-4826-b8fc-349dcd055355","Type":"ContainerStarted","Data":"5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52"}
Jul 06 14:49:56.606415 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:56.606255    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:49:56.606415 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:56.606279    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b" event={"ID":"3f5f5f8b-f5b9-4826-b8fc-349dcd055355","Type":"ContainerStarted","Data":"8ec29dc94a3828a9a4e0f2ecc81365a786ed946782328b71deba24a968370c17"}
Jul 06 14:49:56.667637 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:56.667538    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b" podStartSLOduration=2.273140619 podStartE2EDuration="2.667517654s" totalImagesPullingTime="394.377035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:49:56.665734498 +0000 UTC m=+2099.232642119" watchObservedRunningTime="2026-07-06 14:49:56.667517654 +0000 UTC m=+2099.234425276"
Jul 06 14:49:59.094418 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:49:59.094387    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:50:02.616471 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:02.616443    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:50:04.293478 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.293440    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"]
Jul 06 14:50:04.296726 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.296709    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.338626 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.338599    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-f2544a-serving-cert\""
Jul 06 14:50:04.338976 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.338957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"]
Jul 06 14:50:04.382372 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.382316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1475582e-8866-4d5a-b98f-25435d8b0e18-openshift-service-ca\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.382532 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.382479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.382532 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.382507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slbsc\" (UniqueName: \"kubernetes.io/projected/1475582e-8866-4d5a-b98f-25435d8b0e18-kube-api-access-slbsc\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.483891 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.483855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.483891 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.483893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slbsc\" (UniqueName: \"kubernetes.io/projected/1475582e-8866-4d5a-b98f-25435d8b0e18-kube-api-access-slbsc\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.484107 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.483952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1475582e-8866-4d5a-b98f-25435d8b0e18-openshift-service-ca\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.484107 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:50:04.484016    2581 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-f2544a-serving-cert: secret "maas-api-e2e-api-b-f2544a-serving-cert" not found
Jul 06 14:50:04.484107 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:50:04.484082    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls podName:1475582e-8866-4d5a-b98f-25435d8b0e18 nodeName:}" failed. No retries permitted until 2026-07-06 14:50:04.984060243 +0000 UTC m=+2107.550967857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls") pod "maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" (UID: "1475582e-8866-4d5a-b98f-25435d8b0e18") : secret "maas-api-e2e-api-b-f2544a-serving-cert" not found
Jul 06 14:50:04.484697 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.484679    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1475582e-8866-4d5a-b98f-25435d8b0e18-openshift-service-ca\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.507698 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.507657    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slbsc\" (UniqueName: \"kubernetes.io/projected/1475582e-8866-4d5a-b98f-25435d8b0e18-kube-api-access-slbsc\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.989378 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.989327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:04.991719 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:04.991691    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls\") pod \"maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") " pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:05.207404 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:05.207365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:05.369956 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:05.369922    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"]
Jul 06 14:50:05.373114 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:50:05.373088    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1475582e_8866_4d5a_b98f_25435d8b0e18.slice/crio-386153b4f5b6bc43ff9fcdd83e5734eb8882929bed6277ec0704dac2eb38bcd3 WatchSource:0}: Error finding container 386153b4f5b6bc43ff9fcdd83e5734eb8882929bed6277ec0704dac2eb38bcd3: Status 404 returned error can't find the container with id 386153b4f5b6bc43ff9fcdd83e5734eb8882929bed6277ec0704dac2eb38bcd3
Jul 06 14:50:05.657517 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:05.657425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" event={"ID":"1475582e-8866-4d5a-b98f-25435d8b0e18","Type":"ContainerStarted","Data":"386153b4f5b6bc43ff9fcdd83e5734eb8882929bed6277ec0704dac2eb38bcd3"}
Jul 06 14:50:06.663502 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:06.663459    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" event={"ID":"1475582e-8866-4d5a-b98f-25435d8b0e18","Type":"ContainerStarted","Data":"3657933be3bc783b5d13e04bd88d79b6c76f810fca5d64ea5c234414682f5f21"}
Jul 06 14:50:06.663945 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:06.663528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:06.699832 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:06.699653    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" podStartSLOduration=2.261404965 podStartE2EDuration="2.699632942s" totalImagesPullingTime="438.227977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:50:06.698718889 +0000 UTC m=+2109.265626513" watchObservedRunningTime="2026-07-06 14:50:06.699632942 +0000 UTC m=+2109.266540565"
Jul 06 14:50:12.675575 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:12.675544    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:17.656902 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:17.656865    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"]
Jul 06 14:50:17.657454 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:17.657058    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b" podUID="3f5f5f8b-f5b9-4826-b8fc-349dcd055355" containerName="maas-api" containerID="cri-o://5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52" gracePeriod=30
Jul 06 14:50:17.913007 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:17.912942    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:50:18.015230 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.015190    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-openshift-service-ca\") pod \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") "
Jul 06 14:50:18.015230 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.015223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls\") pod \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") "
Jul 06 14:50:18.015486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.015282    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8l7lp\" (UniqueName: \"kubernetes.io/projected/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-kube-api-access-8l7lp\") pod \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\" (UID: \"3f5f5f8b-f5b9-4826-b8fc-349dcd055355\") "
Jul 06 14:50:18.015619 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.015594    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f5f5f8b-f5b9-4826-b8fc-349dcd055355" (UID: "3f5f5f8b-f5b9-4826-b8fc-349dcd055355"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:50:18.015738 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.015720    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:50:18.017437 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.017415    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-kube-api-access-8l7lp" (OuterVolumeSpecName: "kube-api-access-8l7lp") pod "3f5f5f8b-f5b9-4826-b8fc-349dcd055355" (UID: "3f5f5f8b-f5b9-4826-b8fc-349dcd055355"). InnerVolumeSpecName "kube-api-access-8l7lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:50:18.017516 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.017485    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f5f5f8b-f5b9-4826-b8fc-349dcd055355" (UID: "3f5f5f8b-f5b9-4826-b8fc-349dcd055355"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:50:18.083096 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.083062    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:50:18.117003 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.116972    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:50:18.117003 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.116996    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8l7lp\" (UniqueName: \"kubernetes.io/projected/3f5f5f8b-f5b9-4826-b8fc-349dcd055355-kube-api-access-8l7lp\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:50:18.728313 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.728274    2581 generic.go:356] "Generic (PLEG): container finished" podID="3f5f5f8b-f5b9-4826-b8fc-349dcd055355" containerID="5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52" exitCode=0
Jul 06 14:50:18.728728 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.728321    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"
Jul 06 14:50:18.728728 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.728343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b" event={"ID":"3f5f5f8b-f5b9-4826-b8fc-349dcd055355","Type":"ContainerDied","Data":"5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52"}
Jul 06 14:50:18.728728 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.728423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b" event={"ID":"3f5f5f8b-f5b9-4826-b8fc-349dcd055355","Type":"ContainerDied","Data":"8ec29dc94a3828a9a4e0f2ecc81365a786ed946782328b71deba24a968370c17"}
Jul 06 14:50:18.728728 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.728451    2581 scope.go:117] "RemoveContainer" containerID="5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52"
Jul 06 14:50:18.737348 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.737326    2581 scope.go:117] "RemoveContainer" containerID="5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52"
Jul 06 14:50:18.737637 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:50:18.737619    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52\": container with ID starting with 5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52 not found: ID does not exist" containerID="5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52"
Jul 06 14:50:18.737704 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.737646    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52"} err="failed to get container status \"5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52\": rpc error: code = NotFound desc = could not find container \"5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52\": container with ID starting with 5099f2b3f803b56c65ed2e443ef79ca23a743dfc9c509c50b470d6187d98ae52 not found: ID does not exist"
Jul 06 14:50:18.752030 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.752003    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"]
Jul 06 14:50:18.756603 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.756581    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-a89965-6796c75bcc-8484b"]
Jul 06 14:50:18.849938 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:18.849908    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f5f5f8b-f5b9-4826-b8fc-349dcd055355" path="/var/lib/kubelet/pods/3f5f5f8b-f5b9-4826-b8fc-349dcd055355/volumes"
Jul 06 14:50:25.620853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.620822    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"]
Jul 06 14:50:25.621318 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.621029    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" podUID="1475582e-8866-4d5a-b98f-25435d8b0e18" containerName="maas-api" containerID="cri-o://3657933be3bc783b5d13e04bd88d79b6c76f810fca5d64ea5c234414682f5f21" gracePeriod=30
Jul 06 14:50:25.766280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.766243    2581 generic.go:356] "Generic (PLEG): container finished" podID="1475582e-8866-4d5a-b98f-25435d8b0e18" containerID="3657933be3bc783b5d13e04bd88d79b6c76f810fca5d64ea5c234414682f5f21" exitCode=0
Jul 06 14:50:25.766506 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.766395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" event={"ID":"1475582e-8866-4d5a-b98f-25435d8b0e18","Type":"ContainerDied","Data":"3657933be3bc783b5d13e04bd88d79b6c76f810fca5d64ea5c234414682f5f21"}
Jul 06 14:50:25.870689 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.870664    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:25.892947 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.892873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1475582e-8866-4d5a-b98f-25435d8b0e18-openshift-service-ca\") pod \"1475582e-8866-4d5a-b98f-25435d8b0e18\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") "
Jul 06 14:50:25.893096 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.892956    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls\") pod \"1475582e-8866-4d5a-b98f-25435d8b0e18\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") "
Jul 06 14:50:25.893096 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.893009    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slbsc\" (UniqueName: \"kubernetes.io/projected/1475582e-8866-4d5a-b98f-25435d8b0e18-kube-api-access-slbsc\") pod \"1475582e-8866-4d5a-b98f-25435d8b0e18\" (UID: \"1475582e-8866-4d5a-b98f-25435d8b0e18\") "
Jul 06 14:50:25.893293 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.893265    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1475582e-8866-4d5a-b98f-25435d8b0e18-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1475582e-8866-4d5a-b98f-25435d8b0e18" (UID: "1475582e-8866-4d5a-b98f-25435d8b0e18"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:50:25.894982 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.894949    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1475582e-8866-4d5a-b98f-25435d8b0e18" (UID: "1475582e-8866-4d5a-b98f-25435d8b0e18"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:50:25.895092 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.895005    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1475582e-8866-4d5a-b98f-25435d8b0e18-kube-api-access-slbsc" (OuterVolumeSpecName: "kube-api-access-slbsc") pod "1475582e-8866-4d5a-b98f-25435d8b0e18" (UID: "1475582e-8866-4d5a-b98f-25435d8b0e18"). InnerVolumeSpecName "kube-api-access-slbsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:50:25.993809 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.993771    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1475582e-8866-4d5a-b98f-25435d8b0e18-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:50:25.993809 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.993802    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1475582e-8866-4d5a-b98f-25435d8b0e18-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:50:25.993809 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:25.993815    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slbsc\" (UniqueName: \"kubernetes.io/projected/1475582e-8866-4d5a-b98f-25435d8b0e18-kube-api-access-slbsc\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:50:26.772081 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:26.772054    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"
Jul 06 14:50:26.772530 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:26.772054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb" event={"ID":"1475582e-8866-4d5a-b98f-25435d8b0e18","Type":"ContainerDied","Data":"386153b4f5b6bc43ff9fcdd83e5734eb8882929bed6277ec0704dac2eb38bcd3"}
Jul 06 14:50:26.772530 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:26.772189    2581 scope.go:117] "RemoveContainer" containerID="3657933be3bc783b5d13e04bd88d79b6c76f810fca5d64ea5c234414682f5f21"
Jul 06 14:50:26.811693 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:26.811664    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"]
Jul 06 14:50:26.816246 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:26.816222    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-f2544a-596dc84b84-nwwcb"]
Jul 06 14:50:26.850387 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:26.850339    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1475582e-8866-4d5a-b98f-25435d8b0e18" path="/var/lib/kubelet/pods/1475582e-8866-4d5a-b98f-25435d8b0e18/volumes"
Jul 06 14:50:28.579447 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:28.579412    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:50:37.215398 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215365    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"]
Jul 06 14:50:37.215784 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215724    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1475582e-8866-4d5a-b98f-25435d8b0e18" containerName="maas-api"
Jul 06 14:50:37.215784 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215735    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1475582e-8866-4d5a-b98f-25435d8b0e18" containerName="maas-api"
Jul 06 14:50:37.215784 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215748    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f5f5f8b-f5b9-4826-b8fc-349dcd055355" containerName="maas-api"
Jul 06 14:50:37.215784 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215754    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f5f5f8b-f5b9-4826-b8fc-349dcd055355" containerName="maas-api"
Jul 06 14:50:37.215919 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215821    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f5f5f8b-f5b9-4826-b8fc-349dcd055355" containerName="maas-api"
Jul 06 14:50:37.215919 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.215833    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1475582e-8866-4d5a-b98f-25435d8b0e18" containerName="maas-api"
Jul 06 14:50:37.218653 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.218636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.225930 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.225903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-e9ff6b-serving-cert\""
Jul 06 14:50:37.226063 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.226042    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xhhn7\""
Jul 06 14:50:37.253122 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.253094    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"]
Jul 06 14:50:37.309170 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.309124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.309431 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.309197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.309431 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.309309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6ngw\" (UniqueName: \"kubernetes.io/projected/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-kube-api-access-r6ngw\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.410890 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.410852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.411106 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.410946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6ngw\" (UniqueName: \"kubernetes.io/projected/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-kube-api-access-r6ngw\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.411106 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.411013    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.411634 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.411615    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-openshift-service-ca\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.413276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.413244    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-maas-api-tls\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.419487 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.419462    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6ngw\" (UniqueName: \"kubernetes.io/projected/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-kube-api-access-r6ngw\") pod \"maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") " pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.529282 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.529241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:37.673098 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.673068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"]
Jul 06 14:50:37.677078 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:50:37.677053    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7036f8ad_33d2_4272_8fed_e6b65b74b5c8.slice/crio-ebce08a8f6dd49f05fbe69122b724681d42be7602d1af2e7dd01a5ca7386dcf9 WatchSource:0}: Error finding container ebce08a8f6dd49f05fbe69122b724681d42be7602d1af2e7dd01a5ca7386dcf9: Status 404 returned error can't find the container with id ebce08a8f6dd49f05fbe69122b724681d42be7602d1af2e7dd01a5ca7386dcf9
Jul 06 14:50:37.824607 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:37.824520    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx" event={"ID":"7036f8ad-33d2-4272-8fed-e6b65b74b5c8","Type":"ContainerStarted","Data":"ebce08a8f6dd49f05fbe69122b724681d42be7602d1af2e7dd01a5ca7386dcf9"}
Jul 06 14:50:38.830695 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:38.830666    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx" event={"ID":"7036f8ad-33d2-4272-8fed-e6b65b74b5c8","Type":"ContainerStarted","Data":"d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35"}
Jul 06 14:50:38.831089 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:38.830769    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:38.857732 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:38.857683    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx" podStartSLOduration=1.448642074 podStartE2EDuration="1.857667734s" totalImagesPullingTime="409.02566ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:50:38.855884605 +0000 UTC m=+2141.422792226" watchObservedRunningTime="2026-07-06 14:50:38.857667734 +0000 UTC m=+2141.424575354"
Jul 06 14:50:42.465430 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:42.465390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:50:44.841342 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:44.841312    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:50:45.098971 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.098893    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"]
Jul 06 14:50:45.102620 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.102597    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.105027 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.104998    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-91c777-serving-cert\""
Jul 06 14:50:45.118238 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.118210    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"]
Jul 06 14:50:45.196232 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.196202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b433ae-37ed-4887-adbf-fee16e963e60-openshift-service-ca\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.196422 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.196299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2djz\" (UniqueName: \"kubernetes.io/projected/25b433ae-37ed-4887-adbf-fee16e963e60-kube-api-access-q2djz\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.196422 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.196400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25b433ae-37ed-4887-adbf-fee16e963e60-maas-api-tls\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.297456 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.297411    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b433ae-37ed-4887-adbf-fee16e963e60-openshift-service-ca\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.297636 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.297521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2djz\" (UniqueName: \"kubernetes.io/projected/25b433ae-37ed-4887-adbf-fee16e963e60-kube-api-access-q2djz\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.297636 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.297593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25b433ae-37ed-4887-adbf-fee16e963e60-maas-api-tls\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.298096 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.298075    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b433ae-37ed-4887-adbf-fee16e963e60-openshift-service-ca\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.299955 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.299938    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25b433ae-37ed-4887-adbf-fee16e963e60-maas-api-tls\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.309450 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.309421    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2djz\" (UniqueName: \"kubernetes.io/projected/25b433ae-37ed-4887-adbf-fee16e963e60-kube-api-access-q2djz\") pod \"maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") " pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.413656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.413566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:45.569747 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.569721    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"]
Jul 06 14:50:45.572526 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:50:45.572497    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b433ae_37ed_4887_adbf_fee16e963e60.slice/crio-c6865ea93b05de586466e9c02c79bf3bdc6a4f27f612445242abf414070bb655 WatchSource:0}: Error finding container c6865ea93b05de586466e9c02c79bf3bdc6a4f27f612445242abf414070bb655: Status 404 returned error can't find the container with id c6865ea93b05de586466e9c02c79bf3bdc6a4f27f612445242abf414070bb655
Jul 06 14:50:45.864910 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:45.864875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb" event={"ID":"25b433ae-37ed-4887-adbf-fee16e963e60","Type":"ContainerStarted","Data":"c6865ea93b05de586466e9c02c79bf3bdc6a4f27f612445242abf414070bb655"}
Jul 06 14:50:46.870884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:46.870847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb" event={"ID":"25b433ae-37ed-4887-adbf-fee16e963e60","Type":"ContainerStarted","Data":"b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145"}
Jul 06 14:50:46.871280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:46.870980    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:46.909431 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:46.909381    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb" podStartSLOduration=1.5686153859999998 podStartE2EDuration="1.909334838s" totalImagesPullingTime="340.719452ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:50:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:50:46.907437571 +0000 UTC m=+2149.474345210" watchObservedRunningTime="2026-07-06 14:50:46.909334838 +0000 UTC m=+2149.476242462"
Jul 06 14:50:52.881622 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:52.881547    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:50:58.567373 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:58.567305    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:50:59.903621 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.903591    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"]
Jul 06 14:50:59.908234 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.908212    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:50:59.913946 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.913920    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e9ff6b\"/\"kube-root-ca.crt\""
Jul 06 14:50:59.914102 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.913920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9ff6b\"/\"default-dockercfg-k87qr\""
Jul 06 14:50:59.914196 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.914181    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9ff6b\"/\"auth-test-model-e9ff6b-kserve-self-signed-certs\""
Jul 06 14:50:59.914264 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.914229    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-e9ff6b\"/\"openshift-service-ca.crt\""
Jul 06 14:50:59.920220 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.920193    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"]
Jul 06 14:50:59.939555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.939524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-dshm\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:50:59.939555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.939557    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8982f0-e21a-48f2-a284-5078493d3f3e-tls-certs\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:50:59.939808 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.939639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-home\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:50:59.939808 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.939672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-model-cache\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:50:59.939808 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.939722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-tmp-dir\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:50:59.939808 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:50:59.939788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bxvk\" (UniqueName: \"kubernetes.io/projected/0d8982f0-e21a-48f2-a284-5078493d3f3e-kube-api-access-2bxvk\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.040905 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.040870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-home\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.040905 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.040908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-model-cache\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041175 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.040952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-tmp-dir\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041175 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.040983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bxvk\" (UniqueName: \"kubernetes.io/projected/0d8982f0-e21a-48f2-a284-5078493d3f3e-kube-api-access-2bxvk\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041175 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.041082    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-dshm\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041175 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.041111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8982f0-e21a-48f2-a284-5078493d3f3e-tls-certs\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041417 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.041346    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-model-cache\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.041416    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-home\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.041482 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.041472    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-tmp-dir\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.043306 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.043277    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-dshm\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.043557 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.043540    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8982f0-e21a-48f2-a284-5078493d3f3e-tls-certs\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.051317 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.051299    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bxvk\" (UniqueName: \"kubernetes.io/projected/0d8982f0-e21a-48f2-a284-5078493d3f3e-kube-api-access-2bxvk\") pod \"auth-test-model-e9ff6b-kserve-686b8bf667-72qff\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") " pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.218220 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.218128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:00.384260 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.384227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"]
Jul 06 14:51:00.387369 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:51:00.387327    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d8982f0_e21a_48f2_a284_5078493d3f3e.slice/crio-fc92656c947fdf7bf24204689ef9e22cd5a24b8f5a297d3d7fd905eb36cfbb41 WatchSource:0}: Error finding container fc92656c947fdf7bf24204689ef9e22cd5a24b8f5a297d3d7fd905eb36cfbb41: Status 404 returned error can't find the container with id fc92656c947fdf7bf24204689ef9e22cd5a24b8f5a297d3d7fd905eb36cfbb41
Jul 06 14:51:00.937339 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.937304    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff" event={"ID":"0d8982f0-e21a-48f2-a284-5078493d3f3e","Type":"ContainerStarted","Data":"191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f"}
Jul 06 14:51:00.937339 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.937346    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff" event={"ID":"0d8982f0-e21a-48f2-a284-5078493d3f3e","Type":"ContainerStarted","Data":"fc92656c947fdf7bf24204689ef9e22cd5a24b8f5a297d3d7fd905eb36cfbb41"}
Jul 06 14:51:00.962434 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:00.962380    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff" podStartSLOduration=1.962345278 podStartE2EDuration="1.962345278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:50:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:51:00.962250387 +0000 UTC m=+2163.529158008" watchObservedRunningTime="2026-07-06 14:51:00.962345278 +0000 UTC m=+2163.529252899"
Jul 06 14:51:09.884145 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:09.884110    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:51:10.218632 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:10.218556    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:10.218632 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:10.218606    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:10.230718 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:10.230693    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:10.995984 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:10.995959    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:51:40.158915 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:40.158879    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:51:56.565369 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:51:56.565321    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:52:13.673902 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:52:13.673864    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:52:28.864210 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:52:28.864170    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:52:46.968662 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:52:46.968626    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:53:03.963055 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:03.963019    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:53:21.364320 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:21.364285    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:53:34.758410 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:34.758379    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"]
Jul 06 14:53:39.061473 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:39.061441    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:53:44.474394 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.474335    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"]
Jul 06 14:53:44.477853 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.477837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.480273 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.480256    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9ff6b\"/\"sub-test-model-e9ff6b-kserve-self-signed-certs\""
Jul 06 14:53:44.490251 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.490227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"]
Jul 06 14:53:44.600117 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.600080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-dshm\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.600295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.600183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-model-cache\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.600295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.600229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-tmp-dir\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.600295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.600267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-home\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.600455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.600305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkkd4\" (UniqueName: \"kubernetes.io/projected/3b282829-4bef-4cb2-a323-76ce9affc9de-kube-api-access-wkkd4\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.600455 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.600342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b282829-4bef-4cb2-a323-76ce9affc9de-tls-certs\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701151 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-dshm\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-model-cache\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-tmp-dir\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-home\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701335 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkkd4\" (UniqueName: \"kubernetes.io/projected/3b282829-4bef-4cb2-a323-76ce9affc9de-kube-api-access-wkkd4\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701568 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b282829-4bef-4cb2-a323-76ce9affc9de-tls-certs\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701731 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701690    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-model-cache\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701731 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701709    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-home\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.701904 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.701746    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-tmp-dir\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.703605 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.703583    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-dshm\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.703876 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.703856    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b282829-4bef-4cb2-a323-76ce9affc9de-tls-certs\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.710792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.710775    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkkd4\" (UniqueName: \"kubernetes.io/projected/3b282829-4bef-4cb2-a323-76ce9affc9de-kube-api-access-wkkd4\") pod \"sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") " pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.787073 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.787031    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:44.940807 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:44.940770    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"]
Jul 06 14:53:44.944273 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:53:44.944242    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3b282829_4bef_4cb2_a323_76ce9affc9de.slice/crio-9f3e743f86b164ba9b3badfadae840c513b007935b752ea53baaaed229b809fa WatchSource:0}: Error finding container 9f3e743f86b164ba9b3badfadae840c513b007935b752ea53baaaed229b809fa: Status 404 returned error can't find the container with id 9f3e743f86b164ba9b3badfadae840c513b007935b752ea53baaaed229b809fa
Jul 06 14:53:45.731664 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:45.731622    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq" event={"ID":"3b282829-4bef-4cb2-a323-76ce9affc9de","Type":"ContainerStarted","Data":"96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661"}
Jul 06 14:53:45.731664 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:45.731669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq" event={"ID":"3b282829-4bef-4cb2-a323-76ce9affc9de","Type":"ContainerStarted","Data":"9f3e743f86b164ba9b3badfadae840c513b007935b752ea53baaaed229b809fa"}
Jul 06 14:53:45.753268 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:45.753209    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq" podStartSLOduration=1.753193801 podStartE2EDuration="1.753193801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:53:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:53:45.751148644 +0000 UTC m=+2328.318056264" watchObservedRunningTime="2026-07-06 14:53:45.753193801 +0000 UTC m=+2328.320101422"
Jul 06 14:53:49.778308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:49.778213    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff" podUID="0d8982f0-e21a-48f2-a284-5078493d3f3e" containerName="main" containerID="cri-o://191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f" gracePeriod=45
Jul 06 14:53:50.030044 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.029986    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:53:50.168443 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168405    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bxvk\" (UniqueName: \"kubernetes.io/projected/0d8982f0-e21a-48f2-a284-5078493d3f3e-kube-api-access-2bxvk\") pod \"0d8982f0-e21a-48f2-a284-5078493d3f3e\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") "
Jul 06 14:53:50.168649 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-home\") pod \"0d8982f0-e21a-48f2-a284-5078493d3f3e\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") "
Jul 06 14:53:50.168649 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168522    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-tmp-dir\") pod \"0d8982f0-e21a-48f2-a284-5078493d3f3e\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") "
Jul 06 14:53:50.168649 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168599    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8982f0-e21a-48f2-a284-5078493d3f3e-tls-certs\") pod \"0d8982f0-e21a-48f2-a284-5078493d3f3e\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") "
Jul 06 14:53:50.168649 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168625    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-dshm\") pod \"0d8982f0-e21a-48f2-a284-5078493d3f3e\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") "
Jul 06 14:53:50.168877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168720    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-home" (OuterVolumeSpecName: "home") pod "0d8982f0-e21a-48f2-a284-5078493d3f3e" (UID: "0d8982f0-e21a-48f2-a284-5078493d3f3e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:50.168877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-model-cache\") pod \"0d8982f0-e21a-48f2-a284-5078493d3f3e\" (UID: \"0d8982f0-e21a-48f2-a284-5078493d3f3e\") "
Jul 06 14:53:50.168877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.168834    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0d8982f0-e21a-48f2-a284-5078493d3f3e" (UID: "0d8982f0-e21a-48f2-a284-5078493d3f3e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:50.169042 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.169017    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-model-cache" (OuterVolumeSpecName: "model-cache") pod "0d8982f0-e21a-48f2-a284-5078493d3f3e" (UID: "0d8982f0-e21a-48f2-a284-5078493d3f3e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:50.169113 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.169097    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-home\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:53:50.169150 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.169121    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-tmp-dir\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:53:50.169150 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.169136    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-model-cache\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:53:50.170856 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.170834    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d8982f0-e21a-48f2-a284-5078493d3f3e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0d8982f0-e21a-48f2-a284-5078493d3f3e" (UID: "0d8982f0-e21a-48f2-a284-5078493d3f3e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:53:50.171035 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.171019    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8982f0-e21a-48f2-a284-5078493d3f3e-kube-api-access-2bxvk" (OuterVolumeSpecName: "kube-api-access-2bxvk") pod "0d8982f0-e21a-48f2-a284-5078493d3f3e" (UID: "0d8982f0-e21a-48f2-a284-5078493d3f3e"). InnerVolumeSpecName "kube-api-access-2bxvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:53:50.171035 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.171023    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-dshm" (OuterVolumeSpecName: "dshm") pod "0d8982f0-e21a-48f2-a284-5078493d3f3e" (UID: "0d8982f0-e21a-48f2-a284-5078493d3f3e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:53:50.270514 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.270482    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8982f0-e21a-48f2-a284-5078493d3f3e-tls-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:53:50.270514 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.270509    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8982f0-e21a-48f2-a284-5078493d3f3e-dshm\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:53:50.270514 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.270519    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bxvk\" (UniqueName: \"kubernetes.io/projected/0d8982f0-e21a-48f2-a284-5078493d3f3e-kube-api-access-2bxvk\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:53:50.756120 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.756085    2581 generic.go:356] "Generic (PLEG): container finished" podID="0d8982f0-e21a-48f2-a284-5078493d3f3e" containerID="191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f" exitCode=0
Jul 06 14:53:50.756303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.756139    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"
Jul 06 14:53:50.756303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.756163    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff" event={"ID":"0d8982f0-e21a-48f2-a284-5078493d3f3e","Type":"ContainerDied","Data":"191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f"}
Jul 06 14:53:50.756303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.756202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff" event={"ID":"0d8982f0-e21a-48f2-a284-5078493d3f3e","Type":"ContainerDied","Data":"fc92656c947fdf7bf24204689ef9e22cd5a24b8f5a297d3d7fd905eb36cfbb41"}
Jul 06 14:53:50.756303 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.756226    2581 scope.go:117] "RemoveContainer" containerID="191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f"
Jul 06 14:53:50.765265 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.765248    2581 scope.go:117] "RemoveContainer" containerID="191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f"
Jul 06 14:53:50.765551 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:53:50.765531    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f\": container with ID starting with 191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f not found: ID does not exist" containerID="191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f"
Jul 06 14:53:50.765616 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.765560    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f"} err="failed to get container status \"191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f\": rpc error: code = NotFound desc = could not find container \"191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f\": container with ID starting with 191eb4fe4d0960bbdac806caf879feaf1bb380cfdea131fadfde2530bb7e545f not found: ID does not exist"
Jul 06 14:53:50.781262 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.781237    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"]
Jul 06 14:53:50.788179 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.788160    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/auth-test-model-e9ff6b-kserve-686b8bf667-72qff"]
Jul 06 14:53:50.850382 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:50.850337    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8982f0-e21a-48f2-a284-5078493d3f3e" path="/var/lib/kubelet/pods/0d8982f0-e21a-48f2-a284-5078493d3f3e/volumes"
Jul 06 14:53:54.787435 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:54.787401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:54.787435 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:54.787440    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:54.800234 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:54.800202    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:55.793083 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:55.793054    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:53:58.155304 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:53:58.155268    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:54:20.369656 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:54:20.369623    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:54:43.368837 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:54:43.368801    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:54:57.642820 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:54:57.642781    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"]
Jul 06 14:55:02.572418 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:02.572376    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:55:04.974448 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.974410    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"]
Jul 06 14:55:04.975016 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.974997    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8982f0-e21a-48f2-a284-5078493d3f3e" containerName="main"
Jul 06 14:55:04.975102 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.975020    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8982f0-e21a-48f2-a284-5078493d3f3e" containerName="main"
Jul 06 14:55:04.975157 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.975103    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8982f0-e21a-48f2-a284-5078493d3f3e" containerName="main"
Jul 06 14:55:04.977982 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.977962    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:04.980489 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.980466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-e9ff6b\"/\"rate-test-model-e9ff6b-kserve-self-signed-certs\""
Jul 06 14:55:04.987466 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:04.987444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"]
Jul 06 14:55:05.079815 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.079777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4dq\" (UniqueName: \"kubernetes.io/projected/21ffbc04-4a33-41f6-8568-ec342471a069-kube-api-access-wx4dq\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.079999 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.079833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-dshm\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.079999 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.079867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ffbc04-4a33-41f6-8568-ec342471a069-tls-certs\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.079999 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.079951    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-tmp-dir\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.080134 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.080002    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-model-cache\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.080134 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.080127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-home\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181279 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4dq\" (UniqueName: \"kubernetes.io/projected/21ffbc04-4a33-41f6-8568-ec342471a069-kube-api-access-wx4dq\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181279 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-dshm\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181591 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181305    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ffbc04-4a33-41f6-8568-ec342471a069-tls-certs\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181591 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181373    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-tmp-dir\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181591 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181400    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-model-cache\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181591 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181462    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-home\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181815 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181766    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-tmp-dir\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181880 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181837    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-model-cache\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.181880 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.181871    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-home\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.183575 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.183554    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-dshm\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.183748 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.183732    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ffbc04-4a33-41f6-8568-ec342471a069-tls-certs\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.189633 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.189612    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4dq\" (UniqueName: \"kubernetes.io/projected/21ffbc04-4a33-41f6-8568-ec342471a069-kube-api-access-wx4dq\") pod \"rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") " pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.287525 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.287488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:05.422395 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:05.422371    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"]
Jul 06 14:55:05.424682 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:55:05.424654    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21ffbc04_4a33_41f6_8568_ec342471a069.slice/crio-772f693744e213ded8441ae98fde3a149012fa8c66aa2ab09bb95314e80696d5 WatchSource:0}: Error finding container 772f693744e213ded8441ae98fde3a149012fa8c66aa2ab09bb95314e80696d5: Status 404 returned error can't find the container with id 772f693744e213ded8441ae98fde3a149012fa8c66aa2ab09bb95314e80696d5
Jul 06 14:55:06.117561 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:06.117515    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm" event={"ID":"21ffbc04-4a33-41f6-8568-ec342471a069","Type":"ContainerStarted","Data":"85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa"}
Jul 06 14:55:06.117561 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:06.117566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm" event={"ID":"21ffbc04-4a33-41f6-8568-ec342471a069","Type":"ContainerStarted","Data":"772f693744e213ded8441ae98fde3a149012fa8c66aa2ab09bb95314e80696d5"}
Jul 06 14:55:06.145545 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:06.145495    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm" podStartSLOduration=2.145478197 podStartE2EDuration="2.145478197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:55:06.1417247 +0000 UTC m=+2408.708632320" watchObservedRunningTime="2026-07-06 14:55:06.145478197 +0000 UTC m=+2408.712385870"
Jul 06 14:55:12.662618 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:12.662570    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq" podUID="3b282829-4bef-4cb2-a323-76ce9affc9de" containerName="main" containerID="cri-o://96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661" gracePeriod=45
Jul 06 14:55:12.923069 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:12.923011    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:55:13.061028 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.060990    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-home\") pod \"3b282829-4bef-4cb2-a323-76ce9affc9de\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") "
Jul 06 14:55:13.061197 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061054    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkkd4\" (UniqueName: \"kubernetes.io/projected/3b282829-4bef-4cb2-a323-76ce9affc9de-kube-api-access-wkkd4\") pod \"3b282829-4bef-4cb2-a323-76ce9affc9de\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") "
Jul 06 14:55:13.061197 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061077    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b282829-4bef-4cb2-a323-76ce9affc9de-tls-certs\") pod \"3b282829-4bef-4cb2-a323-76ce9affc9de\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") "
Jul 06 14:55:13.061197 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061096    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-model-cache\") pod \"3b282829-4bef-4cb2-a323-76ce9affc9de\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") "
Jul 06 14:55:13.061197 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061118    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-tmp-dir\") pod \"3b282829-4bef-4cb2-a323-76ce9affc9de\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") "
Jul 06 14:55:13.061197 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-dshm\") pod \"3b282829-4bef-4cb2-a323-76ce9affc9de\" (UID: \"3b282829-4bef-4cb2-a323-76ce9affc9de\") "
Jul 06 14:55:13.061487 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061333    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-home" (OuterVolumeSpecName: "home") pod "3b282829-4bef-4cb2-a323-76ce9affc9de" (UID: "3b282829-4bef-4cb2-a323-76ce9affc9de"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:13.061547 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061488    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3b282829-4bef-4cb2-a323-76ce9affc9de" (UID: "3b282829-4bef-4cb2-a323-76ce9affc9de"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:13.061547 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061503    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-model-cache" (OuterVolumeSpecName: "model-cache") pod "3b282829-4bef-4cb2-a323-76ce9affc9de" (UID: "3b282829-4bef-4cb2-a323-76ce9affc9de"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:13.061547 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.061538    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-home\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:55:13.063486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.063461    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-dshm" (OuterVolumeSpecName: "dshm") pod "3b282829-4bef-4cb2-a323-76ce9affc9de" (UID: "3b282829-4bef-4cb2-a323-76ce9affc9de"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:55:13.063486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.063469    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3b282829-4bef-4cb2-a323-76ce9affc9de-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3b282829-4bef-4cb2-a323-76ce9affc9de" (UID: "3b282829-4bef-4cb2-a323-76ce9affc9de"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:55:13.063618 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.063492    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b282829-4bef-4cb2-a323-76ce9affc9de-kube-api-access-wkkd4" (OuterVolumeSpecName: "kube-api-access-wkkd4") pod "3b282829-4bef-4cb2-a323-76ce9affc9de" (UID: "3b282829-4bef-4cb2-a323-76ce9affc9de"). InnerVolumeSpecName "kube-api-access-wkkd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:55:13.151767 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.151734    2581 generic.go:356] "Generic (PLEG): container finished" podID="3b282829-4bef-4cb2-a323-76ce9affc9de" containerID="96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661" exitCode=0
Jul 06 14:55:13.151933 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.151784    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"
Jul 06 14:55:13.151933 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.151810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq" event={"ID":"3b282829-4bef-4cb2-a323-76ce9affc9de","Type":"ContainerDied","Data":"96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661"}
Jul 06 14:55:13.151933 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.151847    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq" event={"ID":"3b282829-4bef-4cb2-a323-76ce9affc9de","Type":"ContainerDied","Data":"9f3e743f86b164ba9b3badfadae840c513b007935b752ea53baaaed229b809fa"}
Jul 06 14:55:13.151933 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.151868    2581 scope.go:117] "RemoveContainer" containerID="96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661"
Jul 06 14:55:13.163374 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.163328    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkkd4\" (UniqueName: \"kubernetes.io/projected/3b282829-4bef-4cb2-a323-76ce9affc9de-kube-api-access-wkkd4\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:55:13.163500 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.163483    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3b282829-4bef-4cb2-a323-76ce9affc9de-tls-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:55:13.163543 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.163507    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-model-cache\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:55:13.163543 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.163521    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-tmp-dir\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:55:13.163543 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.163533    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3b282829-4bef-4cb2-a323-76ce9affc9de-dshm\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:55:13.163923 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.163900    2581 scope.go:117] "RemoveContainer" containerID="96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661"
Jul 06 14:55:13.164201 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:55:13.164177    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661\": container with ID starting with 96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661 not found: ID does not exist" containerID="96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661"
Jul 06 14:55:13.164276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.164207    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661"} err="failed to get container status \"96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661\": rpc error: code = NotFound desc = could not find container \"96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661\": container with ID starting with 96fe8762ea683321009d7039e612b4b28dbc659cb7755603d291229d8c206661 not found: ID does not exist"
Jul 06 14:55:13.180039 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.179981    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"]
Jul 06 14:55:13.184817 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:13.184795    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/sub-test-model-e9ff6b-kserve-5b78df8bc5-jhjfq"]
Jul 06 14:55:14.851164 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:14.851123    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b282829-4bef-4cb2-a323-76ce9affc9de" path="/var/lib/kubelet/pods/3b282829-4bef-4cb2-a323-76ce9affc9de/volumes"
Jul 06 14:55:15.288137 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:15.288107    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:15.288309 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:15.288160    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:15.300207 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:15.300184    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:16.178326 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:16.178298    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:55:18.767011 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:18.766970    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:55:37.495750 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:55:37.495673    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:56:02.166193 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:02.166154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:56:18.066555 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:18.066523    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:56:23.180444 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:23.180406    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"]
Jul 06 14:56:34.562645 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:34.562611    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:56:38.506629 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.506569    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm" podUID="21ffbc04-4a33-41f6-8568-ec342471a069" containerName="main" containerID="cri-o://85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa" gracePeriod=45
Jul 06 14:56:38.765605 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.765543    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:56:38.884703 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.884675    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-dshm\") pod \"21ffbc04-4a33-41f6-8568-ec342471a069\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") "
Jul 06 14:56:38.884884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.884727    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ffbc04-4a33-41f6-8568-ec342471a069-tls-certs\") pod \"21ffbc04-4a33-41f6-8568-ec342471a069\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") "
Jul 06 14:56:38.884884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.884806    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-tmp-dir\") pod \"21ffbc04-4a33-41f6-8568-ec342471a069\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") "
Jul 06 14:56:38.884884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.884836    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-home\") pod \"21ffbc04-4a33-41f6-8568-ec342471a069\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") "
Jul 06 14:56:38.884884 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.884859    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-model-cache\") pod \"21ffbc04-4a33-41f6-8568-ec342471a069\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") "
Jul 06 14:56:38.885118 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.884896    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wx4dq\" (UniqueName: \"kubernetes.io/projected/21ffbc04-4a33-41f6-8568-ec342471a069-kube-api-access-wx4dq\") pod \"21ffbc04-4a33-41f6-8568-ec342471a069\" (UID: \"21ffbc04-4a33-41f6-8568-ec342471a069\") "
Jul 06 14:56:38.885186 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.885130    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21ffbc04-4a33-41f6-8568-ec342471a069" (UID: "21ffbc04-4a33-41f6-8568-ec342471a069"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:38.885186 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.885142    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-home" (OuterVolumeSpecName: "home") pod "21ffbc04-4a33-41f6-8568-ec342471a069" (UID: "21ffbc04-4a33-41f6-8568-ec342471a069"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:38.885186 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.885147    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-model-cache" (OuterVolumeSpecName: "model-cache") pod "21ffbc04-4a33-41f6-8568-ec342471a069" (UID: "21ffbc04-4a33-41f6-8568-ec342471a069"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:38.886856 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.886822    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-dshm" (OuterVolumeSpecName: "dshm") pod "21ffbc04-4a33-41f6-8568-ec342471a069" (UID: "21ffbc04-4a33-41f6-8568-ec342471a069"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 14:56:38.886967 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.886853    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21ffbc04-4a33-41f6-8568-ec342471a069-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21ffbc04-4a33-41f6-8568-ec342471a069" (UID: "21ffbc04-4a33-41f6-8568-ec342471a069"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:56:38.887023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.887004    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21ffbc04-4a33-41f6-8568-ec342471a069-kube-api-access-wx4dq" (OuterVolumeSpecName: "kube-api-access-wx4dq") pod "21ffbc04-4a33-41f6-8568-ec342471a069" (UID: "21ffbc04-4a33-41f6-8568-ec342471a069"). InnerVolumeSpecName "kube-api-access-wx4dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:56:38.986021 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.985989    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21ffbc04-4a33-41f6-8568-ec342471a069-tls-certs\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:56:38.986021 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.986015    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-tmp-dir\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:56:38.986021 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.986024    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-home\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:56:38.986253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.986032    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-model-cache\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:56:38.986253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.986040    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wx4dq\" (UniqueName: \"kubernetes.io/projected/21ffbc04-4a33-41f6-8568-ec342471a069-kube-api-access-wx4dq\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:56:38.986253 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:38.986048    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21ffbc04-4a33-41f6-8568-ec342471a069-dshm\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:56:39.566543 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.566510    2581 generic.go:356] "Generic (PLEG): container finished" podID="21ffbc04-4a33-41f6-8568-ec342471a069" containerID="85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa" exitCode=0
Jul 06 14:56:39.566963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.566551    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"
Jul 06 14:56:39.566963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.566590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm" event={"ID":"21ffbc04-4a33-41f6-8568-ec342471a069","Type":"ContainerDied","Data":"85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa"}
Jul 06 14:56:39.566963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.566633    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm" event={"ID":"21ffbc04-4a33-41f6-8568-ec342471a069","Type":"ContainerDied","Data":"772f693744e213ded8441ae98fde3a149012fa8c66aa2ab09bb95314e80696d5"}
Jul 06 14:56:39.566963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.566650    2581 scope.go:117] "RemoveContainer" containerID="85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa"
Jul 06 14:56:39.576085 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.575975    2581 scope.go:117] "RemoveContainer" containerID="85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa"
Jul 06 14:56:39.576240 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:56:39.576219    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa\": container with ID starting with 85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa not found: ID does not exist" containerID="85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa"
Jul 06 14:56:39.576307 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.576249    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa"} err="failed to get container status \"85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa\": rpc error: code = NotFound desc = could not find container \"85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa\": container with ID starting with 85fc4ecd7c7b6b5ac8a6fd5ef5be3f690fad79332d4dd559e16703e13e68aeaa not found: ID does not exist"
Jul 06 14:56:39.590308 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.590276    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"]
Jul 06 14:56:39.594366 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:39.594330    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-e9ff6b/rate-test-model-e9ff6b-kserve-75664bfc9-sgrvm"]
Jul 06 14:56:40.850854 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:56:40.850821    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21ffbc04-4a33-41f6-8568-ec342471a069" path="/var/lib/kubelet/pods/21ffbc04-4a33-41f6-8568-ec342471a069/volumes"
Jul 06 14:57:33.526827 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.526785    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"]
Jul 06 14:57:33.527421 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.527030    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx" podUID="7036f8ad-33d2-4272-8fed-e6b65b74b5c8" containerName="maas-api" containerID="cri-o://d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35" gracePeriod=30
Jul 06 14:57:33.779801 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.779739    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:57:33.843694 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.843660    2581 generic.go:356] "Generic (PLEG): container finished" podID="7036f8ad-33d2-4272-8fed-e6b65b74b5c8" containerID="d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35" exitCode=0
Jul 06 14:57:33.843902 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.843712    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"
Jul 06 14:57:33.843902 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.843720    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx" event={"ID":"7036f8ad-33d2-4272-8fed-e6b65b74b5c8","Type":"ContainerDied","Data":"d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35"}
Jul 06 14:57:33.843902 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.843771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx" event={"ID":"7036f8ad-33d2-4272-8fed-e6b65b74b5c8","Type":"ContainerDied","Data":"ebce08a8f6dd49f05fbe69122b724681d42be7602d1af2e7dd01a5ca7386dcf9"}
Jul 06 14:57:33.843902 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.843796    2581 scope.go:117] "RemoveContainer" containerID="d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35"
Jul 06 14:57:33.852225 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.852207    2581 scope.go:117] "RemoveContainer" containerID="d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35"
Jul 06 14:57:33.852570 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:57:33.852548    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35\": container with ID starting with d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35 not found: ID does not exist" containerID="d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35"
Jul 06 14:57:33.852627 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.852583    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35"} err="failed to get container status \"d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35\": rpc error: code = NotFound desc = could not find container \"d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35\": container with ID starting with d9886c090eb16218c3eca31f9b446f08fe534255234303f9cb34ca2dfa9a4e35 not found: ID does not exist"
Jul 06 14:57:33.901132 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.901100    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6ngw\" (UniqueName: \"kubernetes.io/projected/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-kube-api-access-r6ngw\") pod \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") "
Jul 06 14:57:33.901314 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.901156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-maas-api-tls\") pod \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") "
Jul 06 14:57:33.901314 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.901228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-openshift-service-ca\") pod \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\" (UID: \"7036f8ad-33d2-4272-8fed-e6b65b74b5c8\") "
Jul 06 14:57:33.901642 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.901618    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7036f8ad-33d2-4272-8fed-e6b65b74b5c8" (UID: "7036f8ad-33d2-4272-8fed-e6b65b74b5c8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:57:33.903338 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.903315    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7036f8ad-33d2-4272-8fed-e6b65b74b5c8" (UID: "7036f8ad-33d2-4272-8fed-e6b65b74b5c8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:57:33.903429 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:33.903330    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-kube-api-access-r6ngw" (OuterVolumeSpecName: "kube-api-access-r6ngw") pod "7036f8ad-33d2-4272-8fed-e6b65b74b5c8" (UID: "7036f8ad-33d2-4272-8fed-e6b65b74b5c8"). InnerVolumeSpecName "kube-api-access-r6ngw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:34.001980 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:34.001943    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:57:34.001980 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:34.001973    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6ngw\" (UniqueName: \"kubernetes.io/projected/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-kube-api-access-r6ngw\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:57:34.001980 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:34.001983    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7036f8ad-33d2-4272-8fed-e6b65b74b5c8-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:57:34.167343 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:34.167311    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"]
Jul 06 14:57:34.173587 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:34.173563    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-e9ff6b-7fdd4c9bc6-bzrcx"]
Jul 06 14:57:34.850857 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:34.850820    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7036f8ad-33d2-4272-8fed-e6b65b74b5c8" path="/var/lib/kubelet/pods/7036f8ad-33d2-4272-8fed-e6b65b74b5c8/volumes"
Jul 06 14:57:36.864158 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:36.864128    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:57:40.869872 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:40.869838    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"]
Jul 06 14:57:40.870259 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:40.870048    2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb" podUID="25b433ae-37ed-4887-adbf-fee16e963e60" containerName="maas-api" containerID="cri-o://b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145" gracePeriod=30
Jul 06 14:57:41.121435 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.121375    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:57:41.277486 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.277449    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25b433ae-37ed-4887-adbf-fee16e963e60-maas-api-tls\") pod \"25b433ae-37ed-4887-adbf-fee16e963e60\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") "
Jul 06 14:57:41.277661 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.277551    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b433ae-37ed-4887-adbf-fee16e963e60-openshift-service-ca\") pod \"25b433ae-37ed-4887-adbf-fee16e963e60\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") "
Jul 06 14:57:41.277661 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.277610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2djz\" (UniqueName: \"kubernetes.io/projected/25b433ae-37ed-4887-adbf-fee16e963e60-kube-api-access-q2djz\") pod \"25b433ae-37ed-4887-adbf-fee16e963e60\" (UID: \"25b433ae-37ed-4887-adbf-fee16e963e60\") "
Jul 06 14:57:41.277963 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.277938    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25b433ae-37ed-4887-adbf-fee16e963e60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "25b433ae-37ed-4887-adbf-fee16e963e60" (UID: "25b433ae-37ed-4887-adbf-fee16e963e60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 14:57:41.279574 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.279549    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/25b433ae-37ed-4887-adbf-fee16e963e60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "25b433ae-37ed-4887-adbf-fee16e963e60" (UID: "25b433ae-37ed-4887-adbf-fee16e963e60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 14:57:41.279703 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.279680    2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/25b433ae-37ed-4887-adbf-fee16e963e60-kube-api-access-q2djz" (OuterVolumeSpecName: "kube-api-access-q2djz") pod "25b433ae-37ed-4887-adbf-fee16e963e60" (UID: "25b433ae-37ed-4887-adbf-fee16e963e60"). InnerVolumeSpecName "kube-api-access-q2djz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 14:57:41.378503 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.378409    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2djz\" (UniqueName: \"kubernetes.io/projected/25b433ae-37ed-4887-adbf-fee16e963e60-kube-api-access-q2djz\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:57:41.378503 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.378448    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/25b433ae-37ed-4887-adbf-fee16e963e60-maas-api-tls\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:57:41.378503 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.378459    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/25b433ae-37ed-4887-adbf-fee16e963e60-openshift-service-ca\") on node \"ip-10-0-139-175.ec2.internal\" DevicePath \"\""
Jul 06 14:57:41.885312 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.885269    2581 generic.go:356] "Generic (PLEG): container finished" podID="25b433ae-37ed-4887-adbf-fee16e963e60" containerID="b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145" exitCode=0
Jul 06 14:57:41.885312 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.885316    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"
Jul 06 14:57:41.885830 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.885325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb" event={"ID":"25b433ae-37ed-4887-adbf-fee16e963e60","Type":"ContainerDied","Data":"b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145"}
Jul 06 14:57:41.885830 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.885401    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb" event={"ID":"25b433ae-37ed-4887-adbf-fee16e963e60","Type":"ContainerDied","Data":"c6865ea93b05de586466e9c02c79bf3bdc6a4f27f612445242abf414070bb655"}
Jul 06 14:57:41.885830 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.885434    2581 scope.go:117] "RemoveContainer" containerID="b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145"
Jul 06 14:57:41.895109 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.895087    2581 scope.go:117] "RemoveContainer" containerID="b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145"
Jul 06 14:57:41.895391 ip-10-0-139-175 kubenswrapper[2581]: E0706 14:57:41.895366    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145\": container with ID starting with b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145 not found: ID does not exist" containerID="b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145"
Jul 06 14:57:41.895492 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.895396    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145"} err="failed to get container status \"b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145\": rpc error: code = NotFound desc = could not find container \"b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145\": container with ID starting with b98499ad86efd9db4d2260739026aa62f21cc3f13818f9ba2f6dd2a0bc9c0145 not found: ID does not exist"
Jul 06 14:57:41.907197 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.907171    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"]
Jul 06 14:57:41.913695 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:41.913674    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-91c777-95d8dfb77-jp4tb"]
Jul 06 14:57:42.850280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:42.850247    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25b433ae-37ed-4887-adbf-fee16e963e60" path="/var/lib/kubelet/pods/25b433ae-37ed-4887-adbf-fee16e963e60/volumes"
Jul 06 14:57:50.566792 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:50.566754    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-qq27t"]
Jul 06 14:57:53.465588 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:53.465540    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5cc87ffcb6-77b26_5bea7a52-6409-43e2-8c78-a81f0878caf8/maas-api/0.log"
Jul 06 14:57:54.483558 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:54.483528    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84ddbc8dff-gf6gb_12f60f6e-5b29-47eb-808c-d689824f0045/copy-manifests/0.log"
Jul 06 14:57:54.492173 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:54.492148    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84ddbc8dff-gf6gb_12f60f6e-5b29-47eb-808c-d689824f0045/manager/0.log"
Jul 06 14:57:56.324835 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:56.324810    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7vccv_f8b1c0fa-6a35-42b5-a078-ba874320e024/kuadrant-console-plugin/0.log"
Jul 06 14:57:56.738194 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:56.738114    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qq27t_d109d833-47e8-44a5-8543-08e14f63c8bc/limitador/0.log"
Jul 06 14:57:57.472794 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:57.472750    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fbc98d46f-47flg_0fabfc4f-0da1-4620-b5d6-8b348d954c37/kube-auth-proxy/0.log"
Jul 06 14:57:58.106344 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:58.106284    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d666965-mp6f2_a2e91868-666d-47ef-936e-af7cd501f98e/router/0.log"
Jul 06 14:57:58.474271 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:58.474194    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-f5f22_f9401f0c-942a-4ab3-b97d-fa831007f105/main/0.log"
Jul 06 14:57:58.958877 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:58.958849    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-hdgdx_4c4f3919-7e25-45e5-97b0-6e53042da17e/main/0.log"
Jul 06 14:57:59.069280 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:57:59.069248    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-pf5zn_6494efbb-1d75-434b-8723-0e7d98387e77/main/0.log"
Jul 06 14:58:03.879899 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.879861    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpkfs/must-gather-4dhq2"]
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880749    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21ffbc04-4a33-41f6-8568-ec342471a069" containerName="main"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880772    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="21ffbc04-4a33-41f6-8568-ec342471a069" containerName="main"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880789    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7036f8ad-33d2-4272-8fed-e6b65b74b5c8" containerName="maas-api"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880797    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7036f8ad-33d2-4272-8fed-e6b65b74b5c8" containerName="maas-api"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880842    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b282829-4bef-4cb2-a323-76ce9affc9de" containerName="main"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880850    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b282829-4bef-4cb2-a323-76ce9affc9de" containerName="main"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880873    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25b433ae-37ed-4887-adbf-fee16e963e60" containerName="maas-api"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.880881    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="25b433ae-37ed-4887-adbf-fee16e963e60" containerName="maas-api"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.881032    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="25b433ae-37ed-4887-adbf-fee16e963e60" containerName="maas-api"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.881055    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7036f8ad-33d2-4272-8fed-e6b65b74b5c8" containerName="maas-api"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.881064    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b282829-4bef-4cb2-a323-76ce9affc9de" containerName="main"
Jul 06 14:58:03.883020 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.881074    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="21ffbc04-4a33-41f6-8568-ec342471a069" containerName="main"
Jul 06 14:58:03.886619 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.886594    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:03.888850 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.888831    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpkfs\"/\"kube-root-ca.crt\""
Jul 06 14:58:03.888975 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.888886    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xpkfs\"/\"openshift-service-ca.crt\""
Jul 06 14:58:03.889487 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.889471    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xpkfs\"/\"default-dockercfg-lwn9w\""
Jul 06 14:58:03.895075 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.895054    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpkfs/must-gather-4dhq2"]
Jul 06 14:58:03.981108 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.981075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz265\" (UniqueName: \"kubernetes.io/projected/57145596-e65e-45f8-b84a-ee918ae92be8-kube-api-access-mz265\") pod \"must-gather-4dhq2\" (UID: \"57145596-e65e-45f8-b84a-ee918ae92be8\") " pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:03.981295 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:03.981207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57145596-e65e-45f8-b84a-ee918ae92be8-must-gather-output\") pod \"must-gather-4dhq2\" (UID: \"57145596-e65e-45f8-b84a-ee918ae92be8\") " pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:04.081735 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.081697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57145596-e65e-45f8-b84a-ee918ae92be8-must-gather-output\") pod \"must-gather-4dhq2\" (UID: \"57145596-e65e-45f8-b84a-ee918ae92be8\") " pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:04.081918 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.081792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz265\" (UniqueName: \"kubernetes.io/projected/57145596-e65e-45f8-b84a-ee918ae92be8-kube-api-access-mz265\") pod \"must-gather-4dhq2\" (UID: \"57145596-e65e-45f8-b84a-ee918ae92be8\") " pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:04.082052 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.082033    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/57145596-e65e-45f8-b84a-ee918ae92be8-must-gather-output\") pod \"must-gather-4dhq2\" (UID: \"57145596-e65e-45f8-b84a-ee918ae92be8\") " pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:04.090720 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.090690    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz265\" (UniqueName: \"kubernetes.io/projected/57145596-e65e-45f8-b84a-ee918ae92be8-kube-api-access-mz265\") pod \"must-gather-4dhq2\" (UID: \"57145596-e65e-45f8-b84a-ee918ae92be8\") " pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:04.197313 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.197216    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpkfs/must-gather-4dhq2"
Jul 06 14:58:04.336427 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.336398    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpkfs/must-gather-4dhq2"]
Jul 06 14:58:04.339664 ip-10-0-139-175 kubenswrapper[2581]: W0706 14:58:04.339627    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57145596_e65e_45f8_b84a_ee918ae92be8.slice/crio-6003a71a1f2f861b16b33abe38b0f9197a601726c0a76b2a21ca9f6b8175e0e8 WatchSource:0}: Error finding container 6003a71a1f2f861b16b33abe38b0f9197a601726c0a76b2a21ca9f6b8175e0e8: Status 404 returned error can't find the container with id 6003a71a1f2f861b16b33abe38b0f9197a601726c0a76b2a21ca9f6b8175e0e8
Jul 06 14:58:04.341797 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.341781    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 14:58:04.998231 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:04.998197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpkfs/must-gather-4dhq2" event={"ID":"57145596-e65e-45f8-b84a-ee918ae92be8","Type":"ContainerStarted","Data":"6003a71a1f2f861b16b33abe38b0f9197a601726c0a76b2a21ca9f6b8175e0e8"}
Jul 06 14:58:06.006663 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:06.006630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpkfs/must-gather-4dhq2" event={"ID":"57145596-e65e-45f8-b84a-ee918ae92be8","Type":"ContainerStarted","Data":"5f088fd442c129c663c4e17136df631627f2b3e857e69b6c63876aa12538992e"}
Jul 06 14:58:06.006663 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:06.006671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpkfs/must-gather-4dhq2" event={"ID":"57145596-e65e-45f8-b84a-ee918ae92be8","Type":"ContainerStarted","Data":"229977a30dff48a9f83401d48ddb52836e4221e12fb48aeb4083ebd70f0ad652"}
Jul 06 14:58:06.028608 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:06.028542    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpkfs/must-gather-4dhq2" podStartSLOduration=2.012079013 podStartE2EDuration="3.028519037s" totalImagesPullingTime="1.016440024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 14:58:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:06.025942013 +0000 UTC m=+2588.592849633" watchObservedRunningTime="2026-07-06 14:58:06.028519037 +0000 UTC m=+2588.595426659"
Jul 06 14:58:07.142257 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:07.142223    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xdc2z_161ba2bc-42f7-45ff-b323-199ac408eb75/global-pull-secret-syncer/0.log"
Jul 06 14:58:07.327130 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:07.327084    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z47mb_acdd6b44-230e-43ad-8d67-1d846d9c7c80/konnectivity-agent/0.log"
Jul 06 14:58:07.520378 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:07.520324    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-175.ec2.internal_b495462a2361679d3c36d9506f0a53c2/haproxy/0.log"
Jul 06 14:58:13.073846 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:13.073806    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-7vccv_f8b1c0fa-6a35-42b5-a078-ba874320e024/kuadrant-console-plugin/0.log"
Jul 06 14:58:13.268019 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:13.267994    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-qq27t_d109d833-47e8-44a5-8543-08e14f63c8bc/limitador/0.log"
Jul 06 14:58:14.956133 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:14.956093    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/alertmanager/0.log"
Jul 06 14:58:14.982796 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:14.982750    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/config-reloader/0.log"
Jul 06 14:58:15.012489 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.012456    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/kube-rbac-proxy-web/0.log"
Jul 06 14:58:15.042603 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.042566    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/kube-rbac-proxy/0.log"
Jul 06 14:58:15.074501 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.074471    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/kube-rbac-proxy-metric/0.log"
Jul 06 14:58:15.101481 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.101450    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/prom-label-proxy/0.log"
Jul 06 14:58:15.129894 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.129869    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_72d851e7-19c0-4505-ae0c-c4854a1af15d/init-config-reloader/0.log"
Jul 06 14:58:15.226426 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.226327    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-znsxq_c013881c-8444-4493-b6c6-7d7136c45a68/kube-state-metrics/0.log"
Jul 06 14:58:15.250296 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.250265    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-znsxq_c013881c-8444-4493-b6c6-7d7136c45a68/kube-rbac-proxy-main/0.log"
Jul 06 14:58:15.278210 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.278180    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-znsxq_c013881c-8444-4493-b6c6-7d7136c45a68/kube-rbac-proxy-self/0.log"
Jul 06 14:58:15.396759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.396730    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97226_7e64fe5a-d371-401b-8827-84244c0aed5d/node-exporter/0.log"
Jul 06 14:58:15.422529 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.422496    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97226_7e64fe5a-d371-401b-8827-84244c0aed5d/kube-rbac-proxy/0.log"
Jul 06 14:58:15.451750 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.451721    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97226_7e64fe5a-d371-401b-8827-84244c0aed5d/init-textfile/0.log"
Jul 06 14:58:15.700192 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.700164    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frqtj_5e096ac1-fe34-4ba8-8126-b9b33c95c14d/kube-rbac-proxy-main/0.log"
Jul 06 14:58:15.728284 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.728253    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frqtj_5e096ac1-fe34-4ba8-8126-b9b33c95c14d/kube-rbac-proxy-self/0.log"
Jul 06 14:58:15.759759 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.759733    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-frqtj_5e096ac1-fe34-4ba8-8126-b9b33c95c14d/openshift-state-metrics/0.log"
Jul 06 14:58:15.813983 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.813956    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/prometheus/0.log"
Jul 06 14:58:15.839066 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.839034    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/config-reloader/0.log"
Jul 06 14:58:15.887043 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.887014    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/thanos-sidecar/0.log"
Jul 06 14:58:15.960743 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:15.960670    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/kube-rbac-proxy-web/0.log"
Jul 06 14:58:16.024812 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:16.024786    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/kube-rbac-proxy/0.log"
Jul 06 14:58:16.086620 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:16.086591    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/kube-rbac-proxy-thanos/0.log"
Jul 06 14:58:16.117459 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:16.117427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e847f5f2-8490-48ae-b87b-8e7e125a20d7/init-config-reloader/0.log"
Jul 06 14:58:16.206515 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:16.206485    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-lvh2b_092f5bd3-e60d-4605-b1f0-9dca7fd628c7/prometheus-operator-admission-webhook/0.log"
Jul 06 14:58:17.216413 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.216337    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"]
Jul 06 14:58:17.221901 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.221870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.237127 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.237079    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"]
Jul 06 14:58:17.322842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.322383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-sys\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.322842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.322469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-proc\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.322842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.322598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-podres\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.322842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.322699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-lib-modules\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.322842 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.322730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7srw\" (UniqueName: \"kubernetes.io/projected/f6b16a18-1089-42c2-a34b-b2a3aab78190-kube-api-access-m7srw\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424247 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-podres\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424475 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-lib-modules\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424475 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7srw\" (UniqueName: \"kubernetes.io/projected/f6b16a18-1089-42c2-a34b-b2a3aab78190-kube-api-access-m7srw\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424475 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-sys\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424475 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-proc\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424556    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-proc\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424727 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424663    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-podres\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.424826 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.424742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-lib-modules\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.425128 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.425102    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6b16a18-1089-42c2-a34b-b2a3aab78190-sys\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.433829 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.433802    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7srw\" (UniqueName: \"kubernetes.io/projected/f6b16a18-1089-42c2-a34b-b2a3aab78190-kube-api-access-m7srw\") pod \"perf-node-gather-daemonset-d7bjw\" (UID: \"f6b16a18-1089-42c2-a34b-b2a3aab78190\") " pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.534522 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.534484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:17.719021 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:17.718125    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"]
Jul 06 14:58:18.092023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:18.091872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw" event={"ID":"f6b16a18-1089-42c2-a34b-b2a3aab78190","Type":"ContainerStarted","Data":"dcdf006bec9d5e30e79d866f5830028d2440dd956244201629beb18f43279b4c"}
Jul 06 14:58:18.092023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:18.091941    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw" event={"ID":"f6b16a18-1089-42c2-a34b-b2a3aab78190","Type":"ContainerStarted","Data":"c5c0dfe288859073c04255976e5595616c554d10ad1f2fac16a71d70d25623a6"}
Jul 06 14:58:18.092023 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:18.091986    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:18.114922 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:18.114813    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw" podStartSLOduration=1.114790734 podStartE2EDuration="1.114790734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 14:58:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 14:58:18.112974765 +0000 UTC m=+2600.679882387" watchObservedRunningTime="2026-07-06 14:58:18.114790734 +0000 UTC m=+2600.681698356"
Jul 06 14:58:19.335891 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:19.335862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-xqpk2_a3bce3a0-ab8a-4d43-98d0-429aa78c9e0e/volume-data-source-validator/0.log"
Jul 06 14:58:20.497276 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:20.497249    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t5gsc_b2655c6d-264e-406c-a55d-f7820f1615be/dns/0.log"
Jul 06 14:58:20.521055 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:20.521029    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-t5gsc_b2655c6d-264e-406c-a55d-f7820f1615be/kube-rbac-proxy/0.log"
Jul 06 14:58:20.549291 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:20.549233    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dmrjt_ec4a75ec-0842-4829-be3c-89e3efd08144/dns-node-resolver/0.log"
Jul 06 14:58:21.432084 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:21.432055    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-znkxk_f63370ee-d317-4d56-ac8e-8df54e89dd86/node-ca/0.log"
Jul 06 14:58:22.682061 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:22.682030    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fbc98d46f-47flg_0fabfc4f-0da1-4620-b5d6-8b348d954c37/kube-auth-proxy/0.log"
Jul 06 14:58:22.881621 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:22.881591    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d666965-mp6f2_a2e91868-666d-47ef-936e-af7cd501f98e/router/0.log"
Jul 06 14:58:23.654241 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:23.654212    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lcmgr_43b7a0bf-4294-4df1-ae93-a51ff6bf7d2c/serve-healthcheck-canary/0.log"
Jul 06 14:58:24.112537 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:24.112506    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xpkfs/perf-node-gather-daemonset-d7bjw"
Jul 06 14:58:24.137166 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:24.137136    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-v6sbw_05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c/insights-operator/0.log"
Jul 06 14:58:24.138078 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:24.138057    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-v6sbw_05622d4b-d4fe-41ec-a31e-5e63fd9a4c8c/insights-operator/1.log"
Jul 06 14:58:24.308190 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:24.308159    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t47fq_26fee085-30c7-4fcd-8b0f-c9298e083719/kube-rbac-proxy/0.log"
Jul 06 14:58:24.331156 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:24.331128    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t47fq_26fee085-30c7-4fcd-8b0f-c9298e083719/exporter/0.log"
Jul 06 14:58:24.357576 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:24.357549    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t47fq_26fee085-30c7-4fcd-8b0f-c9298e083719/extractor/0.log"
Jul 06 14:58:26.984646 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:26.984609    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5cc87ffcb6-77b26_5bea7a52-6409-43e2-8c78-a81f0878caf8/maas-api/0.log"
Jul 06 14:58:27.474340 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:27.474252    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84ddbc8dff-gf6gb_12f60f6e-5b29-47eb-808c-d689824f0045/manager/0.log"
Jul 06 14:58:27.501067 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:27.501042    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84ddbc8dff-gf6gb_12f60f6e-5b29-47eb-808c-d689824f0045/copy-manifests/0.log"
Jul 06 14:58:28.155080 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:28.155042    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fbc98d46f-47flg_0fabfc4f-0da1-4620-b5d6-8b348d954c37/kube-auth-proxy/0.log"
Jul 06 14:58:28.303707 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:28.303666    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d666965-mp6f2_a2e91868-666d-47ef-936e-af7cd501f98e/router/0.log"
Jul 06 14:58:29.101732 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:29.101706    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-989c88578-ftd8t_d0e71d10-b793-42f0-b3b8-0d7d1b7ebba0/manager/0.log"
Jul 06 14:58:29.713290 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:29.713216    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6fbc98d46f-47flg_0fabfc4f-0da1-4620-b5d6-8b348d954c37/kube-auth-proxy/0.log"
Jul 06 14:58:29.857673 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:29.857631    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b9d666965-mp6f2_a2e91868-666d-47ef-936e-af7cd501f98e/router/0.log"
Jul 06 14:58:34.696139 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:34.696091    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8lljn_903754f2-06bf-4900-a1b4-9786df830b18/kube-storage-version-migrator-operator/1.log"
Jul 06 14:58:34.697228 ip-10-0-139-175 kubenswrapper[2581]: I0706 14:58:34.697202    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-8lljn_903754f2-06bf-4900-a1b4-9786df830b18/kube-storage-version-migrator-operator/0.log"