Jul 14 16:26:17.164911 ip-10-0-142-177 systemd[1]: Starting Kubernetes Kubelet...
Jul 14 16:26:17.559423 ip-10-0-142-177 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:26:17.559423 ip-10-0-142-177 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 14 16:26:17.559423 ip-10-0-142-177 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:26:17.559423 ip-10-0-142-177 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 14 16:26:17.559423 ip-10-0-142-177 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 14 16:26:17.560473 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.560391    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 14 16:26:17.564825 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564811    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:17.564825 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564825    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564829    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564832    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564837    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564841    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564843    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564846    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564848    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564851    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564853    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564856    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564859    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564861    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564864    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564866    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564868    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564871    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564873    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564880    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:17.564892 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564882    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564885    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564887    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564890    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564892    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564895    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564897    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564900    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564903    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564906    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564908    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564910    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564914    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564918    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564920    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564923    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564926    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564929    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564932    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:17.565330 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564934    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564937    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564939    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564941    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564944    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564946    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564948    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564951    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564953    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564955    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564957    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564960    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564962    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564964    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564967    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564970    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564973    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564976    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564979    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564981    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:17.565773 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564983    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564986    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564988    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564991    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564993    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564995    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.564999    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565003    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565005    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565008    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565010    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565013    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565015    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565018    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565020    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565022    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565025    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565027    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565029    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565032    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:17.566366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565035    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565037    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565039    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565043    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565045    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565048    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565051    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565055    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565057    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565059    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565062    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565065    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565067    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565070    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565072    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565074    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565077    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565079    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565082    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565084    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:17.566840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565739    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565745    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565748    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565750    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565753    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565756    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565759    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565762    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565764    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565766    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565769    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565771    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565774    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565777    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565781    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565785    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565788    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565791    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565793    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:17.567329 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565797    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565800    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565802    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565805    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565807    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565809    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565811    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565814    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565816    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565818    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565821    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565823    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565825    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565827    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565830    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565832    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565834    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565836    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565839    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565841    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:17.567814 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565844    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565846    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565848    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565851    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565853    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565855    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565858    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565860    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565862    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565865    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565867    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565869    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565873    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565876    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565878    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565882    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565885    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565887    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565890    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565892    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:17.568289 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565894    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565897    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565899    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565901    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565903    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565906    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565909    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565912    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565915    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565918    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565921    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565923    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565926    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565928    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565930    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565933    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565936    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565938    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565940    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565943    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:17.568787 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565946    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565949    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565952    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565954    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565959    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565962    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565965    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565967    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565970    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565972    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565975    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565977    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565980    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565982    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565985    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565987    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565990    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565992    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565994    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:17.569248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.565997    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566380    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566386    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566390    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566393    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566401    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566404    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566407    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566409    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566412    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566414    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566417    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566420    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566422    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566425    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566427    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566430    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566433    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566436    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566438    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:17.569714 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566440    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566443    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566445    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566448    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566450    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566453    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566455    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566459    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566461    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566463    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566466    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566468    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566471    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566473    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566475    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566479    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566482    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566485    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566488    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566491    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:17.570172 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566493    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566496    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566498    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566501    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566503    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566505    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566508    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566510    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566512    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566515    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566518    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566520    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566522    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566525    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566527    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566530    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566532    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566536    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566538    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:17.570691 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566540    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566543    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566545    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566547    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566549    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566552    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566554    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566556    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566560    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566562    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566565    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566567    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566570    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566572    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566579    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566582    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566584    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566586    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566589    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:17.571140 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566591    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566594    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566596    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566599    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566601    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566603    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566606    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566608    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566611    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566613    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566615    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566618    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566620    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566622    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566625    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566627    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566645    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566648    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566650    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566652    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:17.571607 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566655    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.566657    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566720    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566726    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566732    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566737    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566743    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566750    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566756    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566763    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566766    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566769    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566772    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566776    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566778    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566781    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566785    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566787    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566790    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566793    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566797    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566800    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566803    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566805    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 14 16:26:17.572095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566808    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566812    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566815    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566817    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566820    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566823    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566826    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566829    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566831    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566835    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566839    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566842    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566845    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566848    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566851    2562 flags.go:64] FLAG: --enable-server="true"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566855    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566859    2562 flags.go:64] FLAG: --event-burst="100"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566862    2562 flags.go:64] FLAG: --event-qps="50"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566865    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566867    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566870    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566873    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566876    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566880    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566883    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 14 16:26:17.572670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566886    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566888    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566891    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566894    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566896    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566899    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566902    2562 flags.go:64] FLAG: --feature-gates=""
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566905    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566908    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566911    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566913    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566916    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566919    2562 flags.go:64] FLAG: --help="false"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566922    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-142-177.ec2.internal"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566937    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566940    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566944    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566947    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566951    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566953    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566956    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566959    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566962    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 14 16:26:17.573248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566965    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566968    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566970    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566973    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566976    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566979    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566981    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566985    2562 flags.go:64] FLAG: --lock-file=""
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566987    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566990    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566993    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.566998    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567000    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567003    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567006    2562 flags.go:64] FLAG: --logging-format="text"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567008    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567012    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567014    2562 flags.go:64] FLAG: --manifest-url=""
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567017    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567021    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567023    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567027    2562 flags.go:64] FLAG: --max-pods="110"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567030    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567033    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567035    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 14 16:26:17.573821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567038    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567041    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567043    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567046    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567052    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567055    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567058    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567061    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567064    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567069    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567072    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567075    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567078    2562 flags.go:64] FLAG: --port="10250"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567080    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567083    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a2cb8fc3f91b0fdf"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567087    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567090    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567092    2562 flags.go:64] FLAG: --register-node="true"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567095    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567099    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567101    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567104    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567106    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567114    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567116    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 14 16:26:17.574424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567119    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567122    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567125    2562 flags.go:64] FLAG: --runonce="false"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567128    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567130    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567133    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567136    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567138    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567141    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567144    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567147    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567150    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567153    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567155    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567158    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567161    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567164    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567167    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567172    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567174    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567177    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567181    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567184    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567187    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567197    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 14 16:26:17.575204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567200    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567203    2562 flags.go:64] FLAG: --v="2"
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567207    2562 flags.go:64] FLAG: --version="false"
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567211    2562 flags.go:64] FLAG: --vmodule=""
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567214    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567217    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567354    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567359    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567362    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567365    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567368    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567370    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567373    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567375    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567378    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567380    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567382    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567385    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567388    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567390    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567394    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:17.575990 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567397    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567399    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567402    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567405    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567407    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567410    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567412    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567415    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567418    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567421    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567423    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567426    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567429    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567433    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567436    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567438    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567441    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567444    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567446    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:17.576512 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567448    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567451    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567453    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567455    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567458    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567460    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567462    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567465    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567467    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567469    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567472    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567474    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567478    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567480    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567483    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567485    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567488    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567490    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567493    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567495    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:17.576957 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567498    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567501    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567503    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567506    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567508    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567511    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567513    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567515    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567518    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567520    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567523    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567525    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567527    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567530    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567532    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567534    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567538    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567541    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567544    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:17.577431 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567546    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567549    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567551    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567554    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567557    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567562    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567565    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567568    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567570    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567572    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567575    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567578    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567580    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567583    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567585    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567588    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567590    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567592    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567595    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567597    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:17.577897 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567600    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567602    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567604    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567607    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567609    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.567612    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.567620    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.573792    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.573806    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.573824    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.573830    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573894    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573898    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573901    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:17.578352 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573904    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573906    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573909    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573912    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573914    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573917    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573920    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573922    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573925    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573927    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573930    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573932    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573934    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573937    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573939    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573941    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573944    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573946    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573949    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573951    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:17.578695 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573953    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573956    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573958    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573960    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573962    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573965    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573968    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573970    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573973    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573975    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573977    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573980    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573983    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573985    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573988    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573991    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573993    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573995    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.573998    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574000    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:17.579155 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574002    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574005    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574007    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574010    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574012    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574014    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574016    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574019    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574021    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574023    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574025    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574028    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574030    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574032    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574034    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574037    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574039    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574042    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574044    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574046    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:17.579699 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574049    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574051    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574053    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574055    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574058    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574060    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574062    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574065    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574067    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574069    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574072    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574074    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574076    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574078    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574081    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574083    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574086    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574088    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574090    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574092    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:17.580175 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574094    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574097    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574099    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574102    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574105    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574109    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574112    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574114    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574117    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574120    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574124    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574127    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574130    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574134    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574137    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:17.580669 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574140    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.574145    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574251    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574255    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574258    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574261    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574264    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574266    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574269    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574271    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574273    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574276    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574278    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574281    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574283    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 14 16:26:17.581015 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574286    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574288    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574290    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574293    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574295    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574297    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574299    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574302    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574304    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574306    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574309    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574311    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574313    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574315    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574318    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574321    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574323    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574325    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574328    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574331    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 14 16:26:17.581366 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574334    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574336    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574339    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574341    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574344    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574346    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574348    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574350    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574353    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574355    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574358    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574360    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574362    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574364    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574367    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574369    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574371    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574373    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574376    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 14 16:26:17.581840 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574378    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574380    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574383    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574385    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574387    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574389    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574392    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574394    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574396    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574400    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574402    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574404    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574407    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574409    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574411    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574415    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574418    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574421    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574423    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574426    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 14 16:26:17.582293 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574429    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574431    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574434    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574436    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574440    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574444    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574446    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574449    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574452    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574454    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574457    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574459    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574461    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574464    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574466    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574468    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574470    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574473    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574477    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 14 16:26:17.582868 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574479    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574482    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574484    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574487    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574489    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574491    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574493    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:17.574496    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.574501    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.574586    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.577352    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.580545    2562 server.go:1019] "Starting client certificate rotation"
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.580649    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 16:26:17.583397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.580714    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 14 16:26:17.584433 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.584420    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 16:26:17.590407 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.590392    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 14 16:26:17.600595 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.600581    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 14 16:26:17.602433 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.602420    2562 log.go:25] "Validated CRI v1 image API"
Jul 14 16:26:17.603890 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.603871    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 14 16:26:17.606025 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.606009    2562 fs.go:135] Filesystem UUIDs: map[76787278-116d-46e4-ad67-a29f22f2da95:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e958ad65-1f23-4e14-bd40-d5af71c12732:/dev/nvme0n1p3]
Jul 14 16:26:17.606088 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.606025    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 14 16:26:17.611096 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.610991    2562 manager.go:216] Machine: {Timestamp:2026-07-14 16:26:17.609723852 +0000 UTC m=+0.334352542 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3160198 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2529dead2c78448b87b5f08588feb9 SystemUUID:ec2529de-ad2c-7844-8b87-b5f08588feb9 BootID:2a77aef1-abea-4e9a-809c-fe874674cc92 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d8:91:eb:ca:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d8:91:eb:ca:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:ef:af:45:e4:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 14 16:26:17.611096 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.611090    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 14 16:26:17.611211 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.611153    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 14 16:26:17.615167 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.614946    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 14 16:26:17.615282 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.615256    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 16:26:17.615374 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.615176    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 14 16:26:17.616464 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.616450    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 14 16:26:17.616515 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.616470    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 14 16:26:17.616515 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.616480    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 16:26:17.617179 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.617167    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 14 16:26:17.618407 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.618396    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 14 16:26:17.621224 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621210    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 16:26:17.621378 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621366    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 14 16:26:17.621432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621402    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 14 16:26:17.621432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621417    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 14 16:26:17.621526 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621435    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 14 16:26:17.621526 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621449    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 14 16:26:17.621526 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621461    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 14 16:26:17.621805 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621792    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 16:26:17.621862 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.621814    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 14 16:26:17.624024 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.624009    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 14 16:26:17.625642 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625618    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 14 16:26:17.625690 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625670    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 14 16:26:17.625822 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625812    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 14 16:26:17.625852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625827    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 14 16:26:17.625852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625833    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 14 16:26:17.625852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625839    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 14 16:26:17.625852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625846    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 14 16:26:17.625852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.625851    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 14 16:26:17.626447 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.626439    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 14 16:26:17.626447 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.626447    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 14 16:26:17.626498 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.626453    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 14 16:26:17.626498 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.626458    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 14 16:26:17.626498 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.626465    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 14 16:26:17.626498 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.626473    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 14 16:26:17.627857 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.627845    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 14 16:26:17.627895 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.627858    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 14 16:26:17.630764 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.630748    2562 server.go:1268] "Started kubelet"
Jul 14 16:26:17.630869 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.630827    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 14 16:26:17.631219 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.630829    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 14 16:26:17.631314 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.631257    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 14 16:26:17.631473 ip-10-0-142-177 systemd[1]: Started Kubernetes Kubelet.
Jul 14 16:26:17.631962 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.631918    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 14 16:26:17.632858 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.632378    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 14 16:26:17.632858 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.632477    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 14 16:26:17.632858 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.632498    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 14 16:26:17.632858 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.632601    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 14 16:26:17.635747 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.635718    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 14 16:26:17.637826 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.637810    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 14 16:26:17.637826 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.637824    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 14 16:26:17.637971 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.637901    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:17.638408 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.638387    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 14 16:26:17.638408 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.638394    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 14 16:26:17.638522 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.638421    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 14 16:26:17.638522 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.638497    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 14 16:26:17.638522 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.638507    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 14 16:26:17.639415 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639398    2562 factory.go:55] Registering systemd factory
Jul 14 16:26:17.639415 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639415    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 14 16:26:17.639613 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639599    2562 factory.go:153] Registering CRI-O factory
Jul 14 16:26:17.639613 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639613    2562 factory.go:223] Registration of the crio container factory successfully
Jul 14 16:26:17.639741 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639665    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 14 16:26:17.639741 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639684    2562 factory.go:103] Registering Raw factory
Jul 14 16:26:17.639741 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.639693    2562 manager.go:1196] Started watching for new ooms in manager
Jul 14 16:26:17.639741 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.638707    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-177.ec2.internal.18c234ba69807357  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-177.ec2.internal,UID:ip-10-0-142-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-177.ec2.internal,},FirstTimestamp:2026-07-14 16:26:17.630724951 +0000 UTC m=+0.355353642,LastTimestamp:2026-07-14 16:26:17.630724951 +0000 UTC m=+0.355353642,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-177.ec2.internal,}"
Jul 14 16:26:17.640458 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.640439    2562 manager.go:349] Starting recovery of all containers
Jul 14 16:26:17.646647 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.646606    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 14 16:26:17.646741 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.646658    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 14 16:26:17.652237 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.652223    2562 manager.go:354] Recovery completed
Jul 14 16:26:17.652694 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.652578    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sp9r9"
Jul 14 16:26:17.653490 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.653468    2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 14 16:26:17.656187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.656175    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.658667 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.658651    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.658716 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.658685    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.658716 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.658701    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.659172 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659157    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 14 16:26:17.659211 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659172    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.659211 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659178    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 14 16:26:17.659211 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659199    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 14 16:26:17.659939 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659924    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.659998 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659950    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.659998 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.659966    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.660258 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.660193    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-177.ec2.internal.18c234ba6b2ad736  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-177.ec2.internal,UID:ip-10-0-142-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-177.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-177.ec2.internal,},FirstTimestamp:2026-07-14 16:26:17.658668854 +0000 UTC m=+0.383297551,LastTimestamp:2026-07-14 16:26:17.658668854 +0000 UTC m=+0.383297551,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-177.ec2.internal,}"
Jul 14 16:26:17.660353 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.660244    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sp9r9"
Jul 14 16:26:17.660709 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.660699    2562 policy_none.go:49] "None policy: Start"
Jul 14 16:26:17.660744 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.660720    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 14 16:26:17.660744 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.660730    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 14 16:26:17.661855 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.661845    2562 policy_none.go:47] "Start"
Jul 14 16:26:17.691778 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.691764    2562 manager.go:337] "Starting Device Plugin manager"
Jul 14 16:26:17.691835 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.691791    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 14 16:26:17.691835 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.691801    2562 server.go:87] "Starting device plugin registration server"
Jul 14 16:26:17.692027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.692014    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 14 16:26:17.692077 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.692032    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 14 16:26:17.692122 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.692106    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 14 16:26:17.692193 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.692181    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 14 16:26:17.692242 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.692194    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 14 16:26:17.693912 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.693895    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 14 16:26:17.693969 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.693936    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:17.793015 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.792999    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.794296 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.794282    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.794355 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.794310    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.794355 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.794321    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.794355 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.794342    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-177.ec2.internal"
Jul 14 16:26:17.802359 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.802343    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-177.ec2.internal"
Jul 14 16:26:17.802423 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.802363    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-177.ec2.internal\": node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:17.827745 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.827696    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:17.839990 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.839970    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 14 16:26:17.841204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.841191    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 14 16:26:17.841261 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.841223    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 14 16:26:17.841261 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.841239    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 14 16:26:17.841328 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.841267    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 14 16:26:17.843577 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.843561    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:17.927777 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.927750    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:17.942150 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.942131    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"]
Jul 14 16:26:17.942216 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.942191    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.942904 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.942891    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.942967 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.942916    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.942967 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.942925    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.944263 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944253    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.944420 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:17.944455 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944434    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.944930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944909    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.945005 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944938    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.945005 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944948    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.945005 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.944915    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.945117 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.945009    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.945117 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.945019    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.946206 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.946193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:17.946252 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.946215    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 14 16:26:17.946833 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.946817    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientMemory"
Jul 14 16:26:17.946933 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.946847    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasNoDiskPressure"
Jul 14 16:26:17.946933 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:17.946860    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeHasSufficientPID"
Jul 14 16:26:17.962206 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.962184    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-177.ec2.internal\" not found" node="ip-10-0-142-177.ec2.internal"
Jul 14 16:26:17.965918 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:17.965903    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-177.ec2.internal\" not found" node="ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.027860 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.027840    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.040660 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.040625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.040752 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.040668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.040752 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.040690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d609c1ee768fe3daa3f23cbaf1c3121-config\") pod \"kube-apiserver-proxy-ip-10-0-142-177.ec2.internal\" (UID: \"8d609c1ee768fe3daa3f23cbaf1c3121\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.128592 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.128549    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.140817 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.140799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.140884 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.140822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.140884 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.140837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d609c1ee768fe3daa3f23cbaf1c3121-config\") pod \"kube-apiserver-proxy-ip-10-0-142-177.ec2.internal\" (UID: \"8d609c1ee768fe3daa3f23cbaf1c3121\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.140884 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.140876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8d609c1ee768fe3daa3f23cbaf1c3121-config\") pod \"kube-apiserver-proxy-ip-10-0-142-177.ec2.internal\" (UID: \"8d609c1ee768fe3daa3f23cbaf1c3121\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.140995 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.140894    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.140995 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.140907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342f8b0e0e5d8cd59103fbf014e7c2aa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal\" (UID: \"342f8b0e0e5d8cd59103fbf014e7c2aa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.228967 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.228947    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.264463 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.264447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.269321 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.269306    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:18.329992 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.329966    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.430560 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.430515    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.531007 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.530985    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.578662 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.578628    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 14 16:26:18.579032 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.578800    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 14 16:26:18.631086 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.631064    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.663361 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.663338    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 16:21:18 +0000 UTC" deadline="2028-02-05 23:34:06.165943532 +0000 UTC"
Jul 14 16:26:18.663361 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.663360    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13711h7m47.502586648s"
Jul 14 16:26:18.731682 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.731619    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.776767 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:18.776738    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342f8b0e0e5d8cd59103fbf014e7c2aa.slice/crio-f510cb92fdc8a2ec449e133cbb499f16f32d3b6850ad57e4454d5496db5c0b54 WatchSource:0}: Error finding container f510cb92fdc8a2ec449e133cbb499f16f32d3b6850ad57e4454d5496db5c0b54: Status 404 returned error can't find the container with id f510cb92fdc8a2ec449e133cbb499f16f32d3b6850ad57e4454d5496db5c0b54
Jul 14 16:26:18.777035 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:18.777020    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d609c1ee768fe3daa3f23cbaf1c3121.slice/crio-4acc516b5f7d1495f88b0bb55ddb8e35c0dd090049e735d58b82ea3c6fd28125 WatchSource:0}: Error finding container 4acc516b5f7d1495f88b0bb55ddb8e35c0dd090049e735d58b82ea3c6fd28125: Status 404 returned error can't find the container with id 4acc516b5f7d1495f88b0bb55ddb8e35c0dd090049e735d58b82ea3c6fd28125
Jul 14 16:26:18.781817 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.781804    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:26:18.831879 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.831852    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.844647 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.844588    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" event={"ID":"8d609c1ee768fe3daa3f23cbaf1c3121","Type":"ContainerStarted","Data":"4acc516b5f7d1495f88b0bb55ddb8e35c0dd090049e735d58b82ea3c6fd28125"}
Jul 14 16:26:18.845866 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.845845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerStarted","Data":"f510cb92fdc8a2ec449e133cbb499f16f32d3b6850ad57e4454d5496db5c0b54"}
Jul 14 16:26:18.937667 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:18.937625    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:18.986385 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:18.986333    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:19.038491 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.038455    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:19.057681 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.057639    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:19.139325 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.139301    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-177.ec2.internal\" not found"
Jul 14 16:26:19.141108 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.141093    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:19.242913 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.242841    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:19.256109 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.256087    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 16:26:19.257392 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.257378    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal"
Jul 14 16:26:19.267178 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.267161    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 14 16:26:19.624596 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.624542    2562 apiserver.go:52] "Watching apiserver"
Jul 14 16:26:19.630463 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.630444    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 14 16:26:19.630863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.630841    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ns64l","kube-system/konnectivity-agent-wlvlv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6","openshift-image-registry/node-ca-mqbzt","openshift-multus/multus-additional-cni-plugins-wwlbg","openshift-multus/multus-ftsbb","openshift-network-diagnostics/network-check-target-7c9jx","openshift-network-operator/iptables-alerter-bgnm5","kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-778nn","openshift-dns/node-resolver-854nf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal","openshift-multus/network-metrics-daemon-59gvw","openshift-ovn-kubernetes/ovnkube-node-4rfpt"]
Jul 14 16:26:19.633115 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.633098    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:19.633206 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.633180    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:19.634196 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.634173    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:19.634275 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.634235    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:19.635388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.635375    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.636555 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.636537    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.637773 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.637752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.638191 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.638143    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 14 16:26:19.638287 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.638271    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.638427 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.638406    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 14 16:26:19.638487 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.638419    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txdsf\""
Jul 14 16:26:19.638545 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.638487    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.639067 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.639050    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.639257 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.639242    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ckzh7\""
Jul 14 16:26:19.639427 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.639406    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 14 16:26:19.639461 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.639440    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.639572 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.639556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.640520 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.640503    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.640647 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.640632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z6l4n\""
Jul 14 16:26:19.641083 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.641071    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.641604 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.641588    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 14 16:26:19.642085 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.642063    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 14 16:26:19.642199 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.642089    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 14 16:26:19.642199 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.642072    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 14 16:26:19.642199 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.642071    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.642641 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.642626    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jwskw\""
Jul 14 16:26:19.643206 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.643153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.643272 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.643217    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:19.643605 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.643525    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.645154 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.644184    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 14 16:26:19.645154 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.644204    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4scvj\""
Jul 14 16:26:19.645154 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.644981    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 14 16:26:19.645342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.645252    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 14 16:26:19.645666 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.645646    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 14 16:26:19.645859 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.645829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.646278 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:19.646348 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646297    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.646348 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-registration-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.646446 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-cni-binary-copy\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.646446 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-socket-dir-parent\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.646446 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-netns\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.646589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-cni-bin\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.646589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646480    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.646589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-device-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.646589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-sys-fs\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.646589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646554    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.646589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-k8s-cni-cncf-io\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-etc-kubernetes\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slg8w\" (UniqueName: \"kubernetes.io/projected/893092ff-b1fb-40d0-bbed-d3f22c587217-kube-api-access-slg8w\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkz5k\" (UniqueName: \"kubernetes.io/projected/c9b63429-732b-4881-a70d-394bf06fbc66-kube-api-access-hkz5k\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cnibin\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.646930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.646987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-system-cni-dir\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4c6t\" (UniqueName: \"kubernetes.io/projected/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-kube-api-access-m4c6t\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-daemon-config\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-serviceca\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-cni-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-kubelet\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-multus-certs\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsjsr\" (UniqueName: \"kubernetes.io/projected/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-kube-api-access-bsjsr\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647304 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzbqv\" (UniqueName: \"kubernetes.io/projected/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-kube-api-access-rzbqv\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-os-release\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-system-cni-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647494    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-conf-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-cnibin\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-os-release\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-cni-multus\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-hostroot\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-socket-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.647783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.647764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-host\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.649274 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.649094    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 14 16:26:19.649274 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.649186    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 14 16:26:19.649274 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.649202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jdmcw\""
Jul 14 16:26:19.649485 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.649448    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.650631 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.650613    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.650754 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.650725    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.650824 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.650752    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-65tdq\""
Jul 14 16:26:19.650824 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.650784    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.652166 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.652149    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xm5sl\""
Jul 14 16:26:19.652420 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.652398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.652519 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.652401    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.653803 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.653786    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 14 16:26:19.653887 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.653807    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:26:19.653887 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.653816    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xhczx\""
Jul 14 16:26:19.653887 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.653868    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 14 16:26:19.654069 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.654054    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 14 16:26:19.677933 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.677917    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-47wss"
Jul 14 16:26:19.685576 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.685560    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-47wss"
Jul 14 16:26:19.739851 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.739833    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 14 16:26:19.747886 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b886d463-ae23-4843-9aaa-b3affe528856-tmp\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.747959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzbqv\" (UniqueName: \"kubernetes.io/projected/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-kube-api-access-rzbqv\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.747959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-system-cni-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.747959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-conf-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.747959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/627e22df-d8e4-4524-97ff-dac2af422a07-host-slash\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-system-cni-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.747999    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-log-socket\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748072    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-kubernetes\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-conf-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovnkube-script-lib\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-etc-selinux\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.748156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-sys\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748163    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-registration-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748179    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-cni-binary-copy\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-socket-dir-parent\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-netns\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748242    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-netns\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748257    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-registration-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748278    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-socket-dir-parent\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-cni-bin\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-var-lib-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-run\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/627e22df-d8e4-4524-97ff-dac2af422a07-iptables-alerter-script\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748363    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-cni-netd\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748380    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-cni-bin\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-sys-fs\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-sys-fs\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-k8s-cni-cncf-io\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.748537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-etc-kubernetes\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-k8s-cni-cncf-io\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748485    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-ovn\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-etc-kubernetes\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovn-node-metrics-cert\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slg8w\" (UniqueName: \"kubernetes.io/projected/893092ff-b1fb-40d0-bbed-d3f22c587217-kube-api-access-slg8w\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkz5k\" (UniqueName: \"kubernetes.io/projected/c9b63429-732b-4881-a70d-394bf06fbc66-kube-api-access-hkz5k\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748628    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748811    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748840    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748845    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-cni-binary-copy\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748860    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4c6t\" (UniqueName: \"kubernetes.io/projected/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-kube-api-access-m4c6t\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.748895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-cni-bin\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749012    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-run-netns\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.749411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-etc-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-kubelet-config\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5-agent-certs\") pod \"konnectivity-agent-wlvlv\" (UID: \"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5\") " pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b886d463-ae23-4843-9aaa-b3affe528856-etc-tuned\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcsj2\" (UniqueName: \"kubernetes.io/projected/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-kube-api-access-tcsj2\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-cni-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749209    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-kubelet\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-multus-certs\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsjsr\" (UniqueName: \"kubernetes.io/projected/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-kube-api-access-bsjsr\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-dbus\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjgq2\" (UniqueName: \"kubernetes.io/projected/627e22df-d8e4-4524-97ff-dac2af422a07-kube-api-access-wjgq2\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-os-release\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749306    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-cnibin\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-os-release\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749366    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-cni-dir\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-kubelet\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750091 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749487    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-cnibin\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-os-release\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-cni-multus\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-hostroot\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749910    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-var-lib-cni-multus\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749927    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-os-release\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-systemd-units\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749977    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-hostroot\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.749987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovnkube-config\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-host-run-multus-certs\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-env-overrides\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-socket-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750168    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgg8\" (UniqueName: \"kubernetes.io/projected/42b8745d-23b6-42a8-941f-4dee7eb3414b-kube-api-access-gcgg8\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750196    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5-konnectivity-ca\") pod \"konnectivity-agent-wlvlv\" (UID: \"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5\") " pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.750734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-modprobe-d\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysctl-d\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-socket-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-systemd\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-lib-modules\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-var-lib-kubelet\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-host\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750463    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-host\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750508    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-slash\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-systemd\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wxqw\" (UniqueName: \"kubernetes.io/projected/b886d463-ae23-4843-9aaa-b3affe528856-kube-api-access-6wxqw\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-device-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750634    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.751375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-host\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.750690    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-hosts-file\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cnibin\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c9b63429-732b-4881-a70d-394bf06fbc66-device-dir\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750757    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-node-log\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.750811    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:20.250786238 +0000 UTC m=+2.975414919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-system-cni-dir\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cnibin\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-daemon-config\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.750953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-system-cni-dir\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-cni-binary-copy\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-tmp-dir\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-serviceca\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-kubelet\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751206    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysconfig\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.751977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751263    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysctl-conf\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.752728 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-multus-daemon-config\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.752728 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.751473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-serviceca\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.755593 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.755574    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 14 16:26:19.755956 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.755939    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:19.756036 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.755963    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:19.756036 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.755975    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:19.756036 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.756034    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:20.256016065 +0000 UTC m=+2.980644749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:19.759008 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.758986    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4c6t\" (UniqueName: \"kubernetes.io/projected/693784c9-ac94-46a6-9414-8fbe3dcc2cc3-kube-api-access-m4c6t\") pod \"multus-additional-cni-plugins-wwlbg\" (UID: \"693784c9-ac94-46a6-9414-8fbe3dcc2cc3\") " pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.759106 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.759046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzbqv\" (UniqueName: \"kubernetes.io/projected/52a40b3f-8e71-4eca-901f-a4e50ee4f07f-kube-api-access-rzbqv\") pod \"node-ca-mqbzt\" (UID: \"52a40b3f-8e71-4eca-901f-a4e50ee4f07f\") " pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.759151 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.759109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slg8w\" (UniqueName: \"kubernetes.io/projected/893092ff-b1fb-40d0-bbed-d3f22c587217-kube-api-access-slg8w\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:19.759236 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.759214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkz5k\" (UniqueName: \"kubernetes.io/projected/c9b63429-732b-4881-a70d-394bf06fbc66-kube-api-access-hkz5k\") pod \"aws-ebs-csi-driver-node-5gtl6\" (UID: \"c9b63429-732b-4881-a70d-394bf06fbc66\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.759771 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.759755    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsjsr\" (UniqueName: \"kubernetes.io/projected/c29e5162-9f2d-420b-ad97-6fd8f193c9f5-kube-api-access-bsjsr\") pod \"multus-ftsbb\" (UID: \"c29e5162-9f2d-420b-ad97-6fd8f193c9f5\") " pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.851501 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-cni-bin\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851600 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851506    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-run-netns\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851600 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-etc-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851600 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-kubelet-config\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.851600 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851578    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5-agent-certs\") pod \"konnectivity-agent-wlvlv\" (UID: \"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5\") " pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.851600 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-cni-bin\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851600 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-run-netns\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b886d463-ae23-4843-9aaa-b3affe528856-etc-tuned\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-etc-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851625    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-kubelet-config\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcsj2\" (UniqueName: \"kubernetes.io/projected/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-kube-api-access-tcsj2\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-dbus\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851756    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjgq2\" (UniqueName: \"kubernetes.io/projected/627e22df-d8e4-4524-97ff-dac2af422a07-kube-api-access-wjgq2\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-systemd-units\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-dbus\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-systemd-units\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovnkube-config\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-env-overrides\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgg8\" (UniqueName: \"kubernetes.io/projected/42b8745d-23b6-42a8-941f-4dee7eb3414b-kube-api-access-gcgg8\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.851936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5-konnectivity-ca\") pod \"konnectivity-agent-wlvlv\" (UID: \"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5\") " pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851960    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-modprobe-d\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.851985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysctl-d\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852007    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-systemd\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-lib-modules\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-var-lib-kubelet\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852085    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-slash\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852115    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-systemd\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852139    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wxqw\" (UniqueName: \"kubernetes.io/projected/b886d463-ae23-4843-9aaa-b3affe528856-kube-api-access-6wxqw\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-host\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-hosts-file\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852243    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-node-log\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852304    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-tmp-dir\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-kubelet\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.852782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysconfig\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysctl-conf\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852404    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b886d463-ae23-4843-9aaa-b3affe528856-tmp\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852460    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-env-overrides\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/627e22df-d8e4-4524-97ff-dac2af422a07-host-slash\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-log-socket\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.852571    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovnkube-config\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-kubernetes\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:19.852622    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:20.352604248 +0000 UTC m=+3.077232936 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852677    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-hosts-file\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-kubelet\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852759    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-host\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852763    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysctl-d\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-systemd\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-slash\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.853809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5-konnectivity-ca\") pod \"konnectivity-agent-wlvlv\" (UID: \"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5\") " pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/627e22df-d8e4-4524-97ff-dac2af422a07-host-slash\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852909    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-log-socket\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852941    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-lib-modules\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-node-log\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-var-lib-kubelet\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853004    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysconfig\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853021    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-systemd\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-tmp-dir\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853023    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-modprobe-d\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.852572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-kubernetes\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853096    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-etc-sysctl-conf\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovnkube-script-lib\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-sys\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-var-lib-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853171    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-run\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/627e22df-d8e4-4524-97ff-dac2af422a07-iptables-alerter-script\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-cni-netd\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.854693 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-sys\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-var-lib-openvswitch\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-ovn\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853251    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b886d463-ae23-4843-9aaa-b3affe528856-run\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovn-node-metrics-cert\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-run-ovn\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/42b8745d-23b6-42a8-941f-4dee7eb3414b-host-cni-netd\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853801    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovnkube-script-lib\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.853852    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/627e22df-d8e4-4524-97ff-dac2af422a07-iptables-alerter-script\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.854204    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5-agent-certs\") pod \"konnectivity-agent-wlvlv\" (UID: \"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5\") " pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.854357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b886d463-ae23-4843-9aaa-b3affe528856-etc-tuned\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.855570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.855426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b886d463-ae23-4843-9aaa-b3affe528856-tmp\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.855959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.855798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/42b8745d-23b6-42a8-941f-4dee7eb3414b-ovn-node-metrics-cert\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.866814 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.866790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcsj2\" (UniqueName: \"kubernetes.io/projected/7278d9b5-8535-4dde-9d3f-7959c2f50a3c-kube-api-access-tcsj2\") pod \"node-resolver-854nf\" (UID: \"7278d9b5-8535-4dde-9d3f-7959c2f50a3c\") " pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:19.866916 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.866900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgg8\" (UniqueName: \"kubernetes.io/projected/42b8745d-23b6-42a8-941f-4dee7eb3414b-kube-api-access-gcgg8\") pod \"ovnkube-node-4rfpt\" (UID: \"42b8745d-23b6-42a8-941f-4dee7eb3414b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.867356 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.867339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjgq2\" (UniqueName: \"kubernetes.io/projected/627e22df-d8e4-4524-97ff-dac2af422a07-kube-api-access-wjgq2\") pod \"iptables-alerter-bgnm5\" (UID: \"627e22df-d8e4-4524-97ff-dac2af422a07\") " pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:19.867631 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.867612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wxqw\" (UniqueName: \"kubernetes.io/projected/b886d463-ae23-4843-9aaa-b3affe528856-kube-api-access-6wxqw\") pod \"tuned-778nn\" (UID: \"b886d463-ae23-4843-9aaa-b3affe528856\") " pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.948204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.948108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6"
Jul 14 16:26:19.955815 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.955793    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mqbzt"
Jul 14 16:26:19.958296 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:19.958271    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b63429_732b_4881_a70d_394bf06fbc66.slice/crio-4788b6ab5373c87eb60f263d2e099131a5c7b15ac37ead7dc88e93456150501e WatchSource:0}: Error finding container 4788b6ab5373c87eb60f263d2e099131a5c7b15ac37ead7dc88e93456150501e: Status 404 returned error can't find the container with id 4788b6ab5373c87eb60f263d2e099131a5c7b15ac37ead7dc88e93456150501e
Jul 14 16:26:19.964255 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:19.964230    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a40b3f_8e71_4eca_901f_a4e50ee4f07f.slice/crio-b138c5d7052d3fc6bc897f0663d591268c5ec6df4113bc3259617e0ca9adec73 WatchSource:0}: Error finding container b138c5d7052d3fc6bc897f0663d591268c5ec6df4113bc3259617e0ca9adec73: Status 404 returned error can't find the container with id b138c5d7052d3fc6bc897f0663d591268c5ec6df4113bc3259617e0ca9adec73
Jul 14 16:26:19.966666 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.966650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wwlbg"
Jul 14 16:26:19.967487 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.967466    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 14 16:26:19.971915 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.971893    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ftsbb"
Jul 14 16:26:19.977109 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.977086    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:19.978913 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:19.978891    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693784c9_ac94_46a6_9414_8fbe3dcc2cc3.slice/crio-21310bd8c8fd6101d13071680b97c4dda726cee824e6cce0d8e2a9ab40d5cc99 WatchSource:0}: Error finding container 21310bd8c8fd6101d13071680b97c4dda726cee824e6cce0d8e2a9ab40d5cc99: Status 404 returned error can't find the container with id 21310bd8c8fd6101d13071680b97c4dda726cee824e6cce0d8e2a9ab40d5cc99
Jul 14 16:26:19.982662 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.982647    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:19.983247 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:19.983230    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc29e5162_9f2d_420b_ad97_6fd8f193c9f5.slice/crio-bd87442c92005ed0f0240606166472486d35f7e1811cdc23645da06638ea5cd9 WatchSource:0}: Error finding container bd87442c92005ed0f0240606166472486d35f7e1811cdc23645da06638ea5cd9: Status 404 returned error can't find the container with id bd87442c92005ed0f0240606166472486d35f7e1811cdc23645da06638ea5cd9
Jul 14 16:26:19.987270 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:19.987244    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b8745d_23b6_42a8_941f_4dee7eb3414b.slice/crio-a70c198fb1ca6755b3cb3e0559b26aa90d7e5158cbaa3faed85339d9261fd239 WatchSource:0}: Error finding container a70c198fb1ca6755b3cb3e0559b26aa90d7e5158cbaa3faed85339d9261fd239: Status 404 returned error can't find the container with id a70c198fb1ca6755b3cb3e0559b26aa90d7e5158cbaa3faed85339d9261fd239
Jul 14 16:26:19.989031 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.989017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-778nn"
Jul 14 16:26:19.994170 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:19.994148    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-854nf"
Jul 14 16:26:20.000104 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.000086    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bgnm5"
Jul 14 16:26:20.000723 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:20.000696    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb886d463_ae23_4843_9aaa_b3affe528856.slice/crio-0e951de8443f01979f737dd9109960fcb6b4985663dac3dedcff85ab204ed3bc WatchSource:0}: Error finding container 0e951de8443f01979f737dd9109960fcb6b4985663dac3dedcff85ab204ed3bc: Status 404 returned error can't find the container with id 0e951de8443f01979f737dd9109960fcb6b4985663dac3dedcff85ab204ed3bc
Jul 14 16:26:20.003083 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:20.003061    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7278d9b5_8535_4dde_9d3f_7959c2f50a3c.slice/crio-08b1ec93165dfd7e9b7acfe6227a1bb010585e80b8241342a3b68c94ad17cff3 WatchSource:0}: Error finding container 08b1ec93165dfd7e9b7acfe6227a1bb010585e80b8241342a3b68c94ad17cff3: Status 404 returned error can't find the container with id 08b1ec93165dfd7e9b7acfe6227a1bb010585e80b8241342a3b68c94ad17cff3
Jul 14 16:26:20.008842 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:26:20.008818    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod627e22df_d8e4_4524_97ff_dac2af422a07.slice/crio-569f0ffd84d837899b95e9ba4832b1ab36065ea4ff83d4edc06c77235a006cfc WatchSource:0}: Error finding container 569f0ffd84d837899b95e9ba4832b1ab36065ea4ff83d4edc06c77235a006cfc: Status 404 returned error can't find the container with id 569f0ffd84d837899b95e9ba4832b1ab36065ea4ff83d4edc06c77235a006cfc
Jul 14 16:26:20.256090 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.256017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:20.256237 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.256143    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:20.256237 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.256197    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:21.256182842 +0000 UTC m=+3.980811523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:20.356401 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.356371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:20.356521 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.356433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:20.356557 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.356524    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:20.356557 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.356547    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:20.356630 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.356567    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:20.356630 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.356572    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:21.356559513 +0000 UTC m=+4.081188198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:20.356630 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.356577    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:20.356630 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.356621    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:21.356607064 +0000 UTC m=+4.081235744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:20.690775 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.688345    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:21:20 +0000 UTC" deadline="2028-02-04 01:10:15.86843121 +0000 UTC"
Jul 14 16:26:20.690775 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.688411    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13664h43m55.180024288s"
Jul 14 16:26:20.841790 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.841747    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:20.841996 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.841923    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:20.842403 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.842379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:20.842517 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:20.842490    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:20.860822 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.860542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-854nf" event={"ID":"7278d9b5-8535-4dde-9d3f-7959c2f50a3c","Type":"ContainerStarted","Data":"08b1ec93165dfd7e9b7acfe6227a1bb010585e80b8241342a3b68c94ad17cff3"}
Jul 14 16:26:20.863586 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.863553    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-778nn" event={"ID":"b886d463-ae23-4843-9aaa-b3affe528856","Type":"ContainerStarted","Data":"0e951de8443f01979f737dd9109960fcb6b4985663dac3dedcff85ab204ed3bc"}
Jul 14 16:26:20.866747 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.866483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"a70c198fb1ca6755b3cb3e0559b26aa90d7e5158cbaa3faed85339d9261fd239"}
Jul 14 16:26:20.879321 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.879285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ftsbb" event={"ID":"c29e5162-9f2d-420b-ad97-6fd8f193c9f5","Type":"ContainerStarted","Data":"bd87442c92005ed0f0240606166472486d35f7e1811cdc23645da06638ea5cd9"}
Jul 14 16:26:20.889270 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.889149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqbzt" event={"ID":"52a40b3f-8e71-4eca-901f-a4e50ee4f07f","Type":"ContainerStarted","Data":"b138c5d7052d3fc6bc897f0663d591268c5ec6df4113bc3259617e0ca9adec73"}
Jul 14 16:26:20.893725 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.893679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6" event={"ID":"c9b63429-732b-4881-a70d-394bf06fbc66","Type":"ContainerStarted","Data":"4788b6ab5373c87eb60f263d2e099131a5c7b15ac37ead7dc88e93456150501e"}
Jul 14 16:26:20.902825 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.902742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bgnm5" event={"ID":"627e22df-d8e4-4524-97ff-dac2af422a07","Type":"ContainerStarted","Data":"569f0ffd84d837899b95e9ba4832b1ab36065ea4ff83d4edc06c77235a006cfc"}
Jul 14 16:26:20.907654 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.907604    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wlvlv" event={"ID":"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5","Type":"ContainerStarted","Data":"9edd66a24323e01cf5f754bcd44aa9bc56364f6158e1471b055d228cfeb61eda"}
Jul 14 16:26:20.912028 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:20.911998    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerStarted","Data":"21310bd8c8fd6101d13071680b97c4dda726cee824e6cce0d8e2a9ab40d5cc99"}
Jul 14 16:26:21.263327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:21.262983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:21.263327 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.263163    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:21.263327 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.263229    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:23.263207716 +0000 UTC m=+5.987836400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:21.364296 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:21.364072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:21.364296 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:21.364156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:21.364637 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.364304    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:21.364637 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.364333    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:21.364637 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.364347    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:21.364637 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.364405    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:23.364386766 +0000 UTC m=+6.089015466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:21.364637 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.364403    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:21.364637 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.364468    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:23.364448734 +0000 UTC m=+6.089077430 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:21.688948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:21.688857    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 16:21:20 +0000 UTC" deadline="2027-12-14 14:14:45.567601889 +0000 UTC"
Jul 14 16:26:21.688948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:21.688899    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12429h48m23.87870793s"
Jul 14 16:26:21.844371 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:21.844345    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:21.844842 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:21.844482    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:22.841699 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:22.841663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:22.841907 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:22.841833    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:22.842302 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:22.842278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:22.842417 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:22.842392    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:23.284392 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:23.283754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:23.284392 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.283927    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:23.284392 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.283997    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:27.283975891 +0000 UTC m=+10.008604590 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:23.384333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:23.384384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.384520    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.384535    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.384545    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.384587    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:27.384574203 +0000 UTC m=+10.109202883 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.384987    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:23.385071 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.385035    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:27.385022888 +0000 UTC m=+10.109651570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:23.842483 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:23.842452    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:23.842681 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:23.842589    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:24.841795 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:24.841755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:24.842275 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:24.841908    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:24.842275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:24.841984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:24.842275 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:24.842056    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:25.841489 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:25.841455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:25.841688 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:25.841609    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:26.842356 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:26.842291    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:26.843068 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:26.842440    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:26.843068 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:26.842678    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:26.843068 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:26.842805    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:27.319369 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:27.318915    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:27.319369 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.319047    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:27.319369 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.319095    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:35.319082161 +0000 UTC m=+18.043710840 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:27.419764 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:27.419725    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:27.419915 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:27.419785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:27.419971 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.419909    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:27.419971 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.419927    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:27.419971 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.419943    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:27.419971 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.419955    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:27.420085 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.419978    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:35.419959441 +0000 UTC m=+18.144588122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:27.420085 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.420002    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:35.419987596 +0000 UTC m=+18.144616278 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:27.842772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:27.842737    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:27.843223 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:27.842833    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:28.842503 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:28.841890    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:28.842503 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:28.842027    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:28.842503 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:28.842379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:28.842503 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:28.842459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:29.842526 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:29.842494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:29.842897 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:29.842625    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:30.842212 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:30.841981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:30.842410 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:30.842236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:30.842410 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:30.842345    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:30.842771 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:30.842732    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:31.842127 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:31.842085    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:31.842290 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:31.842212    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:32.842323 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:32.842288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:32.842736 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:32.842427    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:32.842736 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:32.842485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:32.842736 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:32.842600    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:33.842002 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:33.841966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:33.842187 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:33.842100    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:34.841863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:34.841831    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:34.841863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:34.841844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:34.842394 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:34.841963    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:34.842394 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:34.842089    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:35.383619 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:35.383577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:35.383817 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.383759    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:35.383889 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.383840    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:51.383817559 +0000 UTC m=+34.108446257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:35.484166 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:35.484123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:35.484356 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:35.484213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:35.484356 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.484314    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:35.484356 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.484328    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:35.484356 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.484345    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:35.484356 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.484359    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:35.484606 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.484400    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:26:51.484375381 +0000 UTC m=+34.209004059 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:35.484606 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.484419    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:26:51.484410259 +0000 UTC m=+34.209038939 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:35.841819 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:35.841724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:35.841986 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:35.841863    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:36.841778 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:36.841746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:36.841778 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:36.841768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:36.841996 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:36.841871    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:36.842285 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:36.842015    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:37.843244 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:37.843214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:37.843714 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:37.843312    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:38.841605 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:38.841559    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:38.841814 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:38.841573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:38.841814 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:38.841707    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:38.841814 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:38.841766    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:39.842422 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:39.841934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:39.842422 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:39.842071    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:40.842221 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:40.841667    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:40.842221 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:40.841795    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:40.842221 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:40.842108    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:40.842221 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:40.842185    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:41.842972 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.842517    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:41.843769 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:41.843008    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:41.958301 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.958250    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-854nf" event={"ID":"7278d9b5-8535-4dde-9d3f-7959c2f50a3c","Type":"ContainerStarted","Data":"8bfbc64dd7440ff07ada8cca8205eb6830e12fbf027c01f631b26e906cd76533"}
Jul 14 16:26:41.960178 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.960139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-778nn" event={"ID":"b886d463-ae23-4843-9aaa-b3affe528856","Type":"ContainerStarted","Data":"b8a05a95de81bc14aa6451a3845e7ebc4a9ac86518976deffe911d8c116a9d46"}
Jul 14 16:26:41.963181 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:26:41.963624 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963599    2562 generic.go:356] "Generic (PLEG): container finished" podID="42b8745d-23b6-42a8-941f-4dee7eb3414b" containerID="c04d052caa41e819d6641fe9d124844d5dce9bbaab16b60a06641bcec3c35d66" exitCode=1
Jul 14 16:26:41.963763 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963698    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"a4dbbf74d4040dccbf35e06a20feb85cc93f43a79c76d8cf005e9a638bc919ca"}
Jul 14 16:26:41.963836 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963777    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"39e4df2d18cb6b2d9c0de443f129aa9d6bcf275b124ec2baf030eb22ecdbb8cc"}
Jul 14 16:26:41.963836 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963827    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"8efa58dfee992c97c5558e15ca617290a465c32e790f4a9139a8095bed1f5053"}
Jul 14 16:26:41.963943 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963874    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"29449fa3aa2dad93cbcb6c5095b34587104317a0b8d8885affb31cb784774167"}
Jul 14 16:26:41.963943 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerDied","Data":"c04d052caa41e819d6641fe9d124844d5dce9bbaab16b60a06641bcec3c35d66"}
Jul 14 16:26:41.964036 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.963971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"6714f1bb0157c9ab1b6f1804a0c513f1b9019b461674b959c7f52b8f6d321d2d"}
Jul 14 16:26:41.965346 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.965323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ftsbb" event={"ID":"c29e5162-9f2d-420b-ad97-6fd8f193c9f5","Type":"ContainerStarted","Data":"6c88879a5371becdd05723370f5f4aa8f51d171764e3bb0733faa0dc800c9f1f"}
Jul 14 16:26:41.966975 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.966942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mqbzt" event={"ID":"52a40b3f-8e71-4eca-901f-a4e50ee4f07f","Type":"ContainerStarted","Data":"8ea4b7d67e132218799ee3bbe63855eaf015b6a7d2fa5dd95cd712fc2a0f34ce"}
Jul 14 16:26:41.968440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.968416    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6" event={"ID":"c9b63429-732b-4881-a70d-394bf06fbc66","Type":"ContainerStarted","Data":"9d4727469f6d2c83876f766d2ef7d8e7a5588db1c7598910b666a40a7f913eeb"}
Jul 14 16:26:41.970004 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.969980    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" event={"ID":"8d609c1ee768fe3daa3f23cbaf1c3121","Type":"ContainerStarted","Data":"6ae2e81e951f0b17b90435f92a0adadadacb604c4dbdcdfe467d32c69601ec19"}
Jul 14 16:26:41.971342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.971317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wlvlv" event={"ID":"9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5","Type":"ContainerStarted","Data":"25592365ae982573a3dd2c47f245e4cc6e3c5484178dd47d6b1d3475d64879f2"}
Jul 14 16:26:41.972947 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.972926    2562 generic.go:356] "Generic (PLEG): container finished" podID="693784c9-ac94-46a6-9414-8fbe3dcc2cc3" containerID="b546ec662a574e2a06e821996091b5e928422e90b1a9722f2bd6b6c3deadc3b8" exitCode=0
Jul 14 16:26:41.973073 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.972957    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerDied","Data":"b546ec662a574e2a06e821996091b5e928422e90b1a9722f2bd6b6c3deadc3b8"}
Jul 14 16:26:41.974982 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.974950    2562 generic.go:356] "Generic (PLEG): container finished" podID="342f8b0e0e5d8cd59103fbf014e7c2aa" containerID="599f7d679cd9b089581d739eaac508ee4d9a8887856365d15c3002634bb38d30" exitCode=0
Jul 14 16:26:41.975092 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:41.974994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerDied","Data":"599f7d679cd9b089581d739eaac508ee4d9a8887856365d15c3002634bb38d30"}
Jul 14 16:26:42.014170 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.014094    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-854nf" podStartSLOduration=3.203270403 podStartE2EDuration="24.014075009s" totalImagesPullingTime="20.810804606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:41.983385165 +0000 UTC m=+24.708013868" watchObservedRunningTime="2026-07-14 16:26:42.014075009 +0000 UTC m=+24.738703710"
Jul 14 16:26:42.014803 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.014761    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mqbzt" podStartSLOduration=7.933950729 podStartE2EDuration="24.014746557s" totalImagesPullingTime="16.080795828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:42.014023336 +0000 UTC m=+24.738652038" watchObservedRunningTime="2026-07-14 16:26:42.014746557 +0000 UTC m=+24.739375259"
Jul 14 16:26:42.089661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.089496    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ftsbb" podStartSLOduration=3.215811879 podStartE2EDuration="24.089475116s" totalImagesPullingTime="20.873663237s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:42.089146372 +0000 UTC m=+24.813775073" watchObservedRunningTime="2026-07-14 16:26:42.089475116 +0000 UTC m=+24.814103823"
Jul 14 16:26:42.164410 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.164361    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-177.ec2.internal" podStartSLOduration=23.164345194 podStartE2EDuration="23.164345194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:42.136751795 +0000 UTC m=+24.861380497" watchObservedRunningTime="2026-07-14 16:26:42.164345194 +0000 UTC m=+24.888973935"
Jul 14 16:26:42.164763 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.164738    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wlvlv" podStartSLOduration=3.343336565 podStartE2EDuration="24.16472052s" totalImagesPullingTime="20.821383955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:42.164111962 +0000 UTC m=+24.888740664" watchObservedRunningTime="2026-07-14 16:26:42.16472052 +0000 UTC m=+24.889349220"
Jul 14 16:26:42.658337 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.658312    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 14 16:26:42.703319 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.703226    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T16:26:42.65833088Z","UUID":"4f23449e-f835-432f-974f-9c91bbb377a3","Handler":null,"Name":"","Endpoint":""}
Jul 14 16:26:42.704888 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.704869    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 14 16:26:42.704985 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.704908    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 14 16:26:42.842023 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.841937    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:42.842189 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:42.842063    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:42.842189 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.842106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:42.842189 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:42.842158    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:42.979929 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.979897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" event={"ID":"342f8b0e0e5d8cd59103fbf014e7c2aa","Type":"ContainerStarted","Data":"697bfb2e34674c9a66246c3f972616f9021002b9ea53b88b51d84616d878ab40"}
Jul 14 16:26:42.981765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.981740    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6" event={"ID":"c9b63429-732b-4881-a70d-394bf06fbc66","Type":"ContainerStarted","Data":"672e61d8b515211773c612c60a00d5d867463b32724f86a420308684a9f245e1"}
Jul 14 16:26:42.983378 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.983346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bgnm5" event={"ID":"627e22df-d8e4-4524-97ff-dac2af422a07","Type":"ContainerStarted","Data":"20377dc586206606127399a138b783161a1ff398ef219b5f2c50b9db8cd8586e"}
Jul 14 16:26:43.000027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:42.999978    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-778nn" podStartSLOduration=4.159837712 podStartE2EDuration="24.99996091s" totalImagesPullingTime="20.840123198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:42.189811363 +0000 UTC m=+24.914440056" watchObservedRunningTime="2026-07-14 16:26:42.99996091 +0000 UTC m=+25.724589612"
Jul 14 16:26:43.000186 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:43.000158    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-177.ec2.internal" podStartSLOduration=24.000148585 podStartE2EDuration="24.000148585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:43.000106084 +0000 UTC m=+25.724734788" watchObservedRunningTime="2026-07-14 16:26:43.000148585 +0000 UTC m=+25.724777288"
Jul 14 16:26:43.020550 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:43.020511    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bgnm5" podStartSLOduration=8.984162416 podStartE2EDuration="25.02049602s" totalImagesPullingTime="16.036333604s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:43.020104037 +0000 UTC m=+25.744732744" watchObservedRunningTime="2026-07-14 16:26:43.02049602 +0000 UTC m=+25.745124724"
Jul 14 16:26:43.842832 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:43.842803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:43.842963 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:43.842916    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:43.988917 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:43.988877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6" event={"ID":"c9b63429-732b-4881-a70d-394bf06fbc66","Type":"ContainerStarted","Data":"1fbc8a472e2a8d8a94064134f5191b7f1e0ba80d80e9161f7450ec4a4b1b9e83"}
Jul 14 16:26:43.992537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:43.992512    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:26:43.993137 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:43.993050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"420d54be7a3237875d2cc5ea242c1282889765c519578d9a26d17f06fc576296"}
Jul 14 16:26:44.015828 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.015779    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5gtl6" podStartSLOduration=2.950144048 podStartE2EDuration="26.015763267s" totalImagesPullingTime="23.065619219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:44.015677062 +0000 UTC m=+26.740305762" watchObservedRunningTime="2026-07-14 16:26:44.015763267 +0000 UTC m=+26.740391998"
Jul 14 16:26:44.666557 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.666521    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:44.667196 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.667172    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:44.842187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.842154    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:44.842348 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.842197    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:44.842348 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:44.842268    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:44.842436 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:44.842400    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:44.996182 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.996074    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:44.996570 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:44.996330    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wlvlv"
Jul 14 16:26:45.841869 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:45.841668    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:45.842056 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:45.841973    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:46.842001 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:46.841969    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:46.842625 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:46.842077    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:46.842625 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:46.842134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:46.842625 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:46.842212    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:47.003287 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.003258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:26:47.003688 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.003665    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"00e8dcd20c9dba6ed40965ac19a6b8f71b1f25a194d0106a06d53fae11e49912"}
Jul 14 16:26:47.003928 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.003909    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:47.004132 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.004114    2562 scope.go:117] "RemoveContainer" containerID="c04d052caa41e819d6641fe9d124844d5dce9bbaab16b60a06641bcec3c35d66"
Jul 14 16:26:47.005620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.005600    2562 generic.go:356] "Generic (PLEG): container finished" podID="693784c9-ac94-46a6-9414-8fbe3dcc2cc3" containerID="85b72dd08b4417b3d2554f03f2049b8452b6f0e3931b9bef768de3379103fd13" exitCode=0
Jul 14 16:26:47.005721 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.005666    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerDied","Data":"85b72dd08b4417b3d2554f03f2049b8452b6f0e3931b9bef768de3379103fd13"}
Jul 14 16:26:47.020958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.020940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:47.843005 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:47.842844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:47.843342 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:47.843089    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:48.011025 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.010978    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:26:48.011392 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.011370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" event={"ID":"42b8745d-23b6-42a8-941f-4dee7eb3414b","Type":"ContainerStarted","Data":"56d1fe53f4a5bedc64cf76ae3976e667699e5966b6210767f7fd7b49abd2cf9c"}
Jul 14 16:26:48.011548 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.011530    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:48.011663 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.011622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:48.013586 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.013564    2562 generic.go:356] "Generic (PLEG): container finished" podID="693784c9-ac94-46a6-9414-8fbe3dcc2cc3" containerID="5c6ed32ceeecf24c5f3053840e9957f1640354f9c855a2bd5e0a426019bddc31" exitCode=0
Jul 14 16:26:48.013680 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.013596    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerDied","Data":"5c6ed32ceeecf24c5f3053840e9957f1640354f9c855a2bd5e0a426019bddc31"}
Jul 14 16:26:48.027324 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.027303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:26:48.060088 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.060049    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt" podStartSLOduration=9.160048451 podStartE2EDuration="30.060037912s" totalImagesPullingTime="20.899989461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:48.059759355 +0000 UTC m=+30.784388055" watchObservedRunningTime="2026-07-14 16:26:48.060037912 +0000 UTC m=+30.784666613"
Jul 14 16:26:48.841691 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.841661    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:48.841845 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:48.841761    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:48.841845 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:48.841818    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:48.841933 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:48.841914    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:49.842236 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:49.842179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:49.842506 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:49.842285    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:50.021176 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:50.021144    2562 generic.go:356] "Generic (PLEG): container finished" podID="693784c9-ac94-46a6-9414-8fbe3dcc2cc3" containerID="0d1b5016b3f1bd04f82212e8474955aee9fe870c3708a4df9c8db88a82588476" exitCode=0
Jul 14 16:26:50.021291 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:50.021232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerDied","Data":"0d1b5016b3f1bd04f82212e8474955aee9fe870c3708a4df9c8db88a82588476"}
Jul 14 16:26:50.841976 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:50.841944    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:50.842147 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:50.842081    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:50.842147 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:50.842134    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:50.842262 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:50.842238    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:51.409624 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:51.409592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:51.409817 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.409770    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:51.409881 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.409841    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs podName:893092ff-b1fb-40d0-bbed-d3f22c587217 nodeName:}" failed. No retries permitted until 2026-07-14 16:27:23.40982274 +0000 UTC m=+66.134451419 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs") pod "network-metrics-daemon-59gvw" (UID: "893092ff-b1fb-40d0-bbed-d3f22c587217") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 14 16:26:51.510478 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:51.510450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:51.510659 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:51.510494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:51.510659 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.510607    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:51.510659 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.510617    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 14 16:26:51.510659 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.510650    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 14 16:26:51.510659 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.510661    2562 projected.go:196] Error preparing data for projected volume kube-api-access-l76zx for pod openshift-network-diagnostics/network-check-target-7c9jx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:51.510937 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.510691    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret podName:8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37 nodeName:}" failed. No retries permitted until 2026-07-14 16:27:23.510671413 +0000 UTC m=+66.235300106 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret") pod "global-pull-secret-syncer-ns64l" (UID: "8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37") : object "kube-system"/"original-pull-secret" not registered
Jul 14 16:26:51.510937 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.510711    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx podName:936e4a9c-f8bb-4332-a112-e9ae4ec31ccc nodeName:}" failed. No retries permitted until 2026-07-14 16:27:23.510701507 +0000 UTC m=+66.235330188 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l76zx" (UniqueName: "kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx") pod "network-check-target-7c9jx" (UID: "936e4a9c-f8bb-4332-a112-e9ae4ec31ccc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 14 16:26:51.841605 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:51.841524    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:51.841779 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:51.841662    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:52.841517 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:52.841483    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:52.841975 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:52.841601    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:52.841975 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:52.841660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:52.841975 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:52.841782    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:53.841944 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:53.841903    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:53.842418 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:53.842040    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:54.841722 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:54.841659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:54.841722 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:54.841692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:54.841861 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:54.841763    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:54.841897 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:54.841867    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:55.034504 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:55.034477    2562 generic.go:356] "Generic (PLEG): container finished" podID="693784c9-ac94-46a6-9414-8fbe3dcc2cc3" containerID="a86894a37069794256f6a4d11271a268838369e5f50b9390ef17cd9efbf86e73" exitCode=0
Jul 14 16:26:55.034820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:55.034534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerDied","Data":"a86894a37069794256f6a4d11271a268838369e5f50b9390ef17cd9efbf86e73"}
Jul 14 16:26:55.842435 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:55.842406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:55.842589 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:55.842520    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:56.039896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:56.039856    2562 generic.go:356] "Generic (PLEG): container finished" podID="693784c9-ac94-46a6-9414-8fbe3dcc2cc3" containerID="384b6672a170d5271ff2e3a19c22beaf9727e2e28c3dbf9e990691ad8b3acb4e" exitCode=0
Jul 14 16:26:56.040252 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:56.039939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerDied","Data":"384b6672a170d5271ff2e3a19c22beaf9727e2e28c3dbf9e990691ad8b3acb4e"}
Jul 14 16:26:56.841920 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:56.841889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:56.842115 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:56.841889    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:56.842115 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:56.841992    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:56.842115 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:56.842071    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:57.045133 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:57.045102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" event={"ID":"693784c9-ac94-46a6-9414-8fbe3dcc2cc3","Type":"ContainerStarted","Data":"080cc179767a4feb5c75236b704b1f7f2cdba9954ec1998d86c7cd4e30ed22f8"}
Jul 14 16:26:57.069912 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:57.069863    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wwlbg" podStartSLOduration=7.226622513 podStartE2EDuration="39.069849702s" totalImagesPullingTime="31.843227189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:26:57.069798001 +0000 UTC m=+39.794426702" watchObservedRunningTime="2026-07-14 16:26:57.069849702 +0000 UTC m=+39.794478402"
Jul 14 16:26:57.842245 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:57.842209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:57.842428 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:57.842296    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:26:58.841596 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:58.841568    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:26:58.841955 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:58.841689    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:26:58.841955 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:58.841744    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:26:58.841955 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:58.841814    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:26:59.842456 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:26:59.842423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:26:59.842840 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:26:59.842524    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:27:00.842085 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:00.842049    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:00.842244 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:00.842102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:00.842244 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:00.842158    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:27:00.842339 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:00.842265    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:27:01.842170 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:01.842139    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:01.842520 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:01.842275    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:27:02.841784 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:02.841748    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:02.841784 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:02.841773    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:02.841973 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:02.841865    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:27:02.842010 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:02.841988    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:27:03.841747 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:03.841716    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:03.842180 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:03.841808    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:27:04.841753 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:04.841724    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:04.842128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:04.841727    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:04.842128 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:04.841811    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:27:04.842128 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:04.841909    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:27:05.841644 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:05.841601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:05.844764 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:05.841743    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:27:06.486027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:06.485825    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ns64l"]
Jul 14 16:27:06.486187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:06.486137    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:06.486274 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:06.486248    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:27:06.490131 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:06.490103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-59gvw"]
Jul 14 16:27:06.490277 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:06.490216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:06.490340 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:06.490318    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:27:06.491402 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:06.491376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7c9jx"]
Jul 14 16:27:06.491542 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:06.491477    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:06.491616 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:06.491566    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:27:07.842611 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:07.842582    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:07.843245 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:07.842679    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7c9jx" podUID="936e4a9c-f8bb-4332-a112-e9ae4ec31ccc"
Jul 14 16:27:07.843245 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:07.842758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:07.843245 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:07.842862    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ns64l" podUID="8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37"
Jul 14 16:27:07.843245 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:07.842887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:07.843245 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:07.842965    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-59gvw" podUID="893092ff-b1fb-40d0-bbed-d3f22c587217"
Jul 14 16:27:09.656793 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.656761    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-177.ec2.internal" event="NodeReady"
Jul 14 16:27:09.657235 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.656863    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 14 16:27:09.714947 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.714796    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4nvl4"]
Jul 14 16:27:09.716951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.716933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.718363 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.718335    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s7tn4"]
Jul 14 16:27:09.720411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.720354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.720581 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.720549    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 14 16:27:09.720754 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.720739    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s2hf7\""
Jul 14 16:27:09.720940 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.720920    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 14 16:27:09.724694 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.724273    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 14 16:27:09.724694 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.724295    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 14 16:27:09.724694 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.724359    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 14 16:27:09.724860 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.724823    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mzcgt\""
Jul 14 16:27:09.724920 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.724888    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 14 16:27:09.732535 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.732506    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4nvl4"]
Jul 14 16:27:09.735931 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.735910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s7tn4"]
Jul 14 16:27:09.750568 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ppmk\" (UniqueName: \"kubernetes.io/projected/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-kube-api-access-5ppmk\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.750727 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-config-volume\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.750727 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-data-volume\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.750727 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcmsb\" (UniqueName: \"kubernetes.io/projected/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-kube-api-access-gcmsb\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.750727 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.750857 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-crio-socket\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.750857 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750784    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.750857 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-metrics-tls\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.750857 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.750814    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-tmp-dir\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.817062 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.817037    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-klcjr"]
Jul 14 16:27:09.819010 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.818995    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:09.821874 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.821857    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 14 16:27:09.821973 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.821857    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 14 16:27:09.821973 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.821915    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 14 16:27:09.822756 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.822742    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s2496\""
Jul 14 16:27:09.833829 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.833807    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-klcjr"]
Jul 14 16:27:09.842270 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.842250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:09.842270 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.842265    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:09.842380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.842275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:09.845784 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.845766    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4qnb\""
Jul 14 16:27:09.846055 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.846042    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 16:27:09.846113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.846097    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 16:27:09.846296 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.846281    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 16:27:09.846342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.846315    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 16:27:09.846386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.846352    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnkj4\""
Jul 14 16:27:09.851050 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-config-volume\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.851135 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-data-volume\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851135 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcmsb\" (UniqueName: \"kubernetes.io/projected/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-kube-api-access-gcmsb\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851214 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851214 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-crio-socket\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851214 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f48a34-04a2-443e-a6bc-5efb622f0eed-cert\") pod \"ingress-canary-klcjr\" (UID: \"e5f48a34-04a2-443e-a6bc-5efb622f0eed\") " pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:09.851365 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851417 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-crio-socket\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851417 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851398    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-data-volume\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851417 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851380    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66flf\" (UniqueName: \"kubernetes.io/projected/e5f48a34-04a2-443e-a6bc-5efb622f0eed-kube-api-access-66flf\") pod \"ingress-canary-klcjr\" (UID: \"e5f48a34-04a2-443e-a6bc-5efb622f0eed\") " pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:09.851559 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-metrics-tls\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.851559 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851462    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-tmp-dir\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.851559 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851492    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ppmk\" (UniqueName: \"kubernetes.io/projected/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-kube-api-access-5ppmk\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.851716 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-config-volume\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.851716 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.851884 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.851867    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-tmp-dir\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.855614 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.855589    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-metrics-tls\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.855723 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.855595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.866062 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.866041    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ppmk\" (UniqueName: \"kubernetes.io/projected/11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c-kube-api-access-5ppmk\") pod \"dns-default-4nvl4\" (UID: \"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c\") " pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:09.866136 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.866075    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcmsb\" (UniqueName: \"kubernetes.io/projected/ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc-kube-api-access-gcmsb\") pod \"insights-runtime-extractor-s7tn4\" (UID: \"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc\") " pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:09.952243 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.952215    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f48a34-04a2-443e-a6bc-5efb622f0eed-cert\") pod \"ingress-canary-klcjr\" (UID: \"e5f48a34-04a2-443e-a6bc-5efb622f0eed\") " pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:09.952376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.952250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66flf\" (UniqueName: \"kubernetes.io/projected/e5f48a34-04a2-443e-a6bc-5efb622f0eed-kube-api-access-66flf\") pod \"ingress-canary-klcjr\" (UID: \"e5f48a34-04a2-443e-a6bc-5efb622f0eed\") " pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:09.954567 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.954546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e5f48a34-04a2-443e-a6bc-5efb622f0eed-cert\") pod \"ingress-canary-klcjr\" (UID: \"e5f48a34-04a2-443e-a6bc-5efb622f0eed\") " pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:09.961230 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:09.961206    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66flf\" (UniqueName: \"kubernetes.io/projected/e5f48a34-04a2-443e-a6bc-5efb622f0eed-kube-api-access-66flf\") pod \"ingress-canary-klcjr\" (UID: \"e5f48a34-04a2-443e-a6bc-5efb622f0eed\") " pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:10.027798 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.027729    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:10.032499 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.032481    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s7tn4"
Jul 14 16:27:10.127690 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.127458    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-klcjr"
Jul 14 16:27:10.199792 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.199666    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4nvl4"]
Jul 14 16:27:10.202885 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:10.202845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a95e67_e8d0_4d06_a3f1_ddf1e4b93c1c.slice/crio-7cc271a7977817532a284dd072bc8b77024d608d1faa37bd43bc32f6d5ffd270 WatchSource:0}: Error finding container 7cc271a7977817532a284dd072bc8b77024d608d1faa37bd43bc32f6d5ffd270: Status 404 returned error can't find the container with id 7cc271a7977817532a284dd072bc8b77024d608d1faa37bd43bc32f6d5ffd270
Jul 14 16:27:10.206376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.206305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s7tn4"]
Jul 14 16:27:10.210376 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:10.209582    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac34b948_5b0c_4b1b_a3a7_dd50e775a7fc.slice/crio-7e35a2d305b2eaf1c88dea8d0cd694b72204dc662f56ba965bcd9b7580de719b WatchSource:0}: Error finding container 7e35a2d305b2eaf1c88dea8d0cd694b72204dc662f56ba965bcd9b7580de719b: Status 404 returned error can't find the container with id 7e35a2d305b2eaf1c88dea8d0cd694b72204dc662f56ba965bcd9b7580de719b
Jul 14 16:27:10.288522 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.288420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-klcjr"]
Jul 14 16:27:10.292269 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:10.292238    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5f48a34_04a2_443e_a6bc_5efb622f0eed.slice/crio-2c37f1b650b0210f0535184992cdabb95bc90d1ca1b3294c77aa4626f8d9e3c7 WatchSource:0}: Error finding container 2c37f1b650b0210f0535184992cdabb95bc90d1ca1b3294c77aa4626f8d9e3c7: Status 404 returned error can't find the container with id 2c37f1b650b0210f0535184992cdabb95bc90d1ca1b3294c77aa4626f8d9e3c7
Jul 14 16:27:10.935398 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.935367    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-72gwt"]
Jul 14 16:27:10.946808 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.946100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:10.949139 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.949101    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 14 16:27:10.949653 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.949426    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 14 16:27:10.950036 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.949760    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 14 16:27:10.950036 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.949867    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 14 16:27:10.951337 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.951101    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 14 16:27:10.951337 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.951165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nxj6x\""
Jul 14 16:27:10.955025 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.954992    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-72gwt"]
Jul 14 16:27:10.967030 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.966997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:10.967239 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.967049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab906c62-c91c-4283-8eca-3c192f9b0f38-metrics-client-ca\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:10.967239 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.967106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:10.967239 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:10.967152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw42f\" (UniqueName: \"kubernetes.io/projected/ab906c62-c91c-4283-8eca-3c192f9b0f38-kube-api-access-xw42f\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.018277 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.018245    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-658757f9b7-8bxdk"]
Jul 14 16:27:11.030274 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.030248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.036046 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.035109    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 14 16:27:11.036046 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.035864    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 14 16:27:11.036046 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.035889    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 14 16:27:11.036275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.036066    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 14 16:27:11.036327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.036288    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 14 16:27:11.036508 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.036486    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fd2jx\""
Jul 14 16:27:11.037139 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.037116    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 14 16:27:11.037239 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.037170    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658757f9b7-8bxdk"]
Jul 14 16:27:11.037698 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.037361    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 14 16:27:11.045803 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.045575    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.067963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-oauth-config\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab906c62-c91c-4283-8eca-3c192f9b0f38-metrics-client-ca\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-config\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-oauth-serving-cert\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-serving-cert\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclps\" (UniqueName: \"kubernetes.io/projected/604e88b0-3d11-447e-8a0a-ce6aecc96d12-kube-api-access-dclps\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068225    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-trusted-ca-bundle\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-service-ca\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.068323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw42f\" (UniqueName: \"kubernetes.io/projected/ab906c62-c91c-4283-8eca-3c192f9b0f38-kube-api-access-xw42f\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:11.068766    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:27:11.068820    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-tls podName:ab906c62-c91c-4283-8eca-3c192f9b0f38 nodeName:}" failed. No retries permitted until 2026-07-14 16:27:11.568801898 +0000 UTC m=+54.293430581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-tls") pod "prometheus-operator-64785b6675-72gwt" (UID: "ab906c62-c91c-4283-8eca-3c192f9b0f38") : secret "prometheus-operator-tls" not found
Jul 14 16:27:11.070386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.069772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab906c62-c91c-4283-8eca-3c192f9b0f38-metrics-client-ca\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.086275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.079214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7tn4" event={"ID":"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc","Type":"ContainerStarted","Data":"7e35a2d305b2eaf1c88dea8d0cd694b72204dc662f56ba965bcd9b7580de719b"}
Jul 14 16:27:11.086275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.082274    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4nvl4" event={"ID":"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c","Type":"ContainerStarted","Data":"7cc271a7977817532a284dd072bc8b77024d608d1faa37bd43bc32f6d5ffd270"}
Jul 14 16:27:11.086275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.086235    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.089113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.089056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw42f\" (UniqueName: \"kubernetes.io/projected/ab906c62-c91c-4283-8eca-3c192f9b0f38-kube-api-access-xw42f\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.090099 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.090041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-klcjr" event={"ID":"e5f48a34-04a2-443e-a6bc-5efb622f0eed","Type":"ContainerStarted","Data":"2c37f1b650b0210f0535184992cdabb95bc90d1ca1b3294c77aa4626f8d9e3c7"}
Jul 14 16:27:11.169371 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-serving-cert\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.169527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169382    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclps\" (UniqueName: \"kubernetes.io/projected/604e88b0-3d11-447e-8a0a-ce6aecc96d12-kube-api-access-dclps\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.169527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-trusted-ca-bundle\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.169527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169455    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-service-ca\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.169527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-oauth-config\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.169765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-config\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.169765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.169597    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-oauth-serving-cert\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.170372 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.170343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-oauth-serving-cert\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.172205 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.171276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-service-ca\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.172432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.172388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-trusted-ca-bundle\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.172432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.172422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-config\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.180504 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.180477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-serving-cert\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.182844 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.182800    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclps\" (UniqueName: \"kubernetes.io/projected/604e88b0-3d11-447e-8a0a-ce6aecc96d12-kube-api-access-dclps\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.183692 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.183666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-oauth-config\") pod \"console-658757f9b7-8bxdk\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") " pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.346298 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.346211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:11.565653 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.562009    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-658757f9b7-8bxdk"]
Jul 14 16:27:11.573878 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.573848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.581753 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.581704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab906c62-c91c-4283-8eca-3c192f9b0f38-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-72gwt\" (UID: \"ab906c62-c91c-4283-8eca-3c192f9b0f38\") " pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:11.861242 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:11.861206    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt"
Jul 14 16:27:12.045175 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:12.045142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-72gwt"]
Jul 14 16:27:12.095274 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:12.095236    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658757f9b7-8bxdk" event={"ID":"604e88b0-3d11-447e-8a0a-ce6aecc96d12","Type":"ContainerStarted","Data":"c32e4c7d3f3a7d42d7960099b3ebaa73bd7f4b69eae3f9b7a3825c90439c04d7"}
Jul 14 16:27:12.649414 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:12.649371    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab906c62_c91c_4283_8eca_3c192f9b0f38.slice/crio-6541a2482f6e76ff5e9624c29c9b2686bb9cf2c396d17a68c86e3072371e7d11 WatchSource:0}: Error finding container 6541a2482f6e76ff5e9624c29c9b2686bb9cf2c396d17a68c86e3072371e7d11: Status 404 returned error can't find the container with id 6541a2482f6e76ff5e9624c29c9b2686bb9cf2c396d17a68c86e3072371e7d11
Jul 14 16:27:13.098989 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:13.098903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt" event={"ID":"ab906c62-c91c-4283-8eca-3c192f9b0f38","Type":"ContainerStarted","Data":"6541a2482f6e76ff5e9624c29c9b2686bb9cf2c396d17a68c86e3072371e7d11"}
Jul 14 16:27:18.113098 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.113066    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658757f9b7-8bxdk" event={"ID":"604e88b0-3d11-447e-8a0a-ce6aecc96d12","Type":"ContainerStarted","Data":"fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477"}
Jul 14 16:27:18.114477 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.114456    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-klcjr" event={"ID":"e5f48a34-04a2-443e-a6bc-5efb622f0eed","Type":"ContainerStarted","Data":"ada4981bbf9a919bb78279f0b7ec9ac65731f4815124af3474be9f8d67f65722"}
Jul 14 16:27:18.116156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.116129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt" event={"ID":"ab906c62-c91c-4283-8eca-3c192f9b0f38","Type":"ContainerStarted","Data":"e8f1a1c79cdc78cb6807af446aeea15e1b093afc4015e9d97f23540607e79daa"}
Jul 14 16:27:18.116237 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.116178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt" event={"ID":"ab906c62-c91c-4283-8eca-3c192f9b0f38","Type":"ContainerStarted","Data":"5cec0c87700e2b5b90beefde23e5bba37823f1ea4b416d894a503b7d37b1955a"}
Jul 14 16:27:18.117757 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.117719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7tn4" event={"ID":"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc","Type":"ContainerStarted","Data":"f91c97e2e763d5312535c746dbf71663a6fc873f5c36d714a166c189b3ece299"}
Jul 14 16:27:18.117856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.117795    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7tn4" event={"ID":"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc","Type":"ContainerStarted","Data":"05ed75c587ff1414afa5c49edcb4dcc03982ee19d972b0b26b4002aa76f13f62"}
Jul 14 16:27:18.119121 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.119098    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4nvl4" event={"ID":"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c","Type":"ContainerStarted","Data":"3052daab82388c3e0541b4eaa81e7b5688e6f467041478675bf101519009fd21"}
Jul 14 16:27:18.119198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.119143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4nvl4" event={"ID":"11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c","Type":"ContainerStarted","Data":"75f3bb6a84bf4dc15d6de3bb7c1fbd621e94c8e00565d73d5cc08a0e85eb2ee3"}
Jul 14 16:27:18.119247 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.119233    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:18.135907 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.135844    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-658757f9b7-8bxdk" podStartSLOduration=2.495613572 podStartE2EDuration="8.135830146s" totalImagesPullingTime="5.640216574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:18.135418324 +0000 UTC m=+60.860047027" watchObservedRunningTime="2026-07-14 16:27:18.135830146 +0000 UTC m=+60.860458826"
Jul 14 16:27:18.154034 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.153994    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4nvl4" podStartSLOduration=3.589961795 podStartE2EDuration="9.153979808s" totalImagesPullingTime="5.564018013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:18.153285906 +0000 UTC m=+60.877914608" watchObservedRunningTime="2026-07-14 16:27:18.153979808 +0000 UTC m=+60.878608510"
Jul 14 16:27:18.170189 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:18.170154    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-klcjr" podStartSLOduration=2.299420817 podStartE2EDuration="9.170144975s" totalImagesPullingTime="6.870724158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:18.169006162 +0000 UTC m=+60.893634866" watchObservedRunningTime="2026-07-14 16:27:18.170144975 +0000 UTC m=+60.894773675"
Jul 14 16:27:20.033240 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.033212    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4rfpt"
Jul 14 16:27:20.074698 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.074647    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-72gwt" podStartSLOduration=5.560378581 podStartE2EDuration="10.074617568s" totalImagesPullingTime="4.514238987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:18.18822535 +0000 UTC m=+60.912854050" watchObservedRunningTime="2026-07-14 16:27:20.074617568 +0000 UTC m=+62.799246247"
Jul 14 16:27:20.351186 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.351117    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"]
Jul 14 16:27:20.359515 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.359492    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.362410 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.362382    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 14 16:27:20.362547 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.362427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 14 16:27:20.362768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.362753    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8zmpr\""
Jul 14 16:27:20.366204 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.366182    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"]
Jul 14 16:27:20.369485 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.369454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"]
Jul 14 16:27:20.370148 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.370132    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.372975 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.372956    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 14 16:27:20.373079 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.372958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-j8rcp\""
Jul 14 16:27:20.373180 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.373164    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 14 16:27:20.373437 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.373399    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 14 16:27:20.391043 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.389761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"]
Jul 14 16:27:20.412173 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.412148    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xtd5m"]
Jul 14 16:27:20.416133 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.416106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.418988 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.418967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qhpw6\""
Jul 14 16:27:20.419441 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.419412    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 14 16:27:20.419441 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.419428    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 14 16:27:20.419551 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.419500    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 14 16:27:20.447447 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f5588b0-0938-4f61-9b0d-b593c368af43-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.447583 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.447583 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f5588b0-0938-4f61-9b0d-b593c368af43-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.447583 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s87f4\" (UniqueName: \"kubernetes.io/projected/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-api-access-s87f4\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.447739 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2t87\" (UniqueName: \"kubernetes.io/projected/7f5588b0-0938-4f61-9b0d-b593c368af43-kube-api-access-f2t87\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.447739 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447702    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.447739 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.447886 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447794    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.447886 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5588b0-0938-4f61-9b0d-b593c368af43-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.447886 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.447863    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.548979 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.548943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.548999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f5588b0-0938-4f61-9b0d-b593c368af43-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.549142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549027    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s87f4\" (UniqueName: \"kubernetes.io/projected/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-api-access-s87f4\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5716100f-473f-49e3-a249-bede6e678744-metrics-client-ca\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5716100f-473f-49e3-a249-bede6e678744-node-exporter-accelerators-collector-config\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-node-exporter-wtmp\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549151    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2t87\" (UniqueName: \"kubernetes.io/projected/7f5588b0-0938-4f61-9b0d-b593c368af43-kube-api-access-f2t87\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5716100f-473f-49e3-a249-bede6e678744-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-root\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549339    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549394 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5588b0-0938-4f61-9b0d-b593c368af43-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.549820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-sys\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.549820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fnjz\" (UniqueName: \"kubernetes.io/projected/5716100f-473f-49e3-a249-bede6e678744-kube-api-access-4fnjz\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5716100f-473f-49e3-a249-bede6e678744-node-exporter-textfile\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5716100f-473f-49e3-a249-bede6e678744-node-exporter-tls\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.549820 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.549674    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f5588b0-0938-4f61-9b0d-b593c368af43-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.550119 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.550055    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.550287 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.550195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.550478 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.550451    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7f5588b0-0938-4f61-9b0d-b593c368af43-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.552774 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.552751    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f5588b0-0938-4f61-9b0d-b593c368af43-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.552774 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.552754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7f5588b0-0938-4f61-9b0d-b593c368af43-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.552931 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.552886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.552931 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.552887    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.561432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.561363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2t87\" (UniqueName: \"kubernetes.io/projected/7f5588b0-0938-4f61-9b0d-b593c368af43-kube-api-access-f2t87\") pod \"openshift-state-metrics-84bd68b896-m94mg\" (UID: \"7f5588b0-0938-4f61-9b0d-b593c368af43\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.563143 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.563124    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s87f4\" (UniqueName: \"kubernetes.io/projected/7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f-kube-api-access-s87f4\") pod \"kube-state-metrics-785778ff74-j5qhv\" (UID: \"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.650152 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5716100f-473f-49e3-a249-bede6e678744-metrics-client-ca\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650152 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5716100f-473f-49e3-a249-bede6e678744-node-exporter-accelerators-collector-config\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-node-exporter-wtmp\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5716100f-473f-49e3-a249-bede6e678744-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-root\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-sys\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fnjz\" (UniqueName: \"kubernetes.io/projected/5716100f-473f-49e3-a249-bede6e678744-kube-api-access-4fnjz\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5716100f-473f-49e3-a249-bede6e678744-node-exporter-textfile\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-node-exporter-wtmp\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5716100f-473f-49e3-a249-bede6e678744-node-exporter-tls\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650341    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-root\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5716100f-473f-49e3-a249-bede6e678744-sys\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650915 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650668    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5716100f-473f-49e3-a249-bede6e678744-node-exporter-textfile\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650915 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5716100f-473f-49e3-a249-bede6e678744-metrics-client-ca\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.650915 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.650837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5716100f-473f-49e3-a249-bede6e678744-node-exporter-accelerators-collector-config\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.652701 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.652681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5716100f-473f-49e3-a249-bede6e678744-node-exporter-tls\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.652826 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.652737    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5716100f-473f-49e3-a249-bede6e678744-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.664203 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.664186    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fnjz\" (UniqueName: \"kubernetes.io/projected/5716100f-473f-49e3-a249-bede6e678744-kube-api-access-4fnjz\") pod \"node-exporter-xtd5m\" (UID: \"5716100f-473f-49e3-a249-bede6e678744\") " pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.671226 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.671209    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"
Jul 14 16:27:20.681529 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.681506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"
Jul 14 16:27:20.726719 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.726696    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xtd5m"
Jul 14 16:27:20.840560 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.840531    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg"]
Jul 14 16:27:20.841328 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:20.841307    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-j5qhv"]
Jul 14 16:27:20.843720 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:20.843699    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cc69c94_a4a6_4c47_ac2e_a3bfb608af3f.slice/crio-cf3b4251aef2a046da02360c31928d303d6f3971f4d11c98c90a75c8ba81a417 WatchSource:0}: Error finding container cf3b4251aef2a046da02360c31928d303d6f3971f4d11c98c90a75c8ba81a417: Status 404 returned error can't find the container with id cf3b4251aef2a046da02360c31928d303d6f3971f4d11c98c90a75c8ba81a417
Jul 14 16:27:20.844242 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:20.844226    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5588b0_0938_4f61_9b0d_b593c368af43.slice/crio-f195a5e1ac0616f3e43aa9b009a5e7540d7c0b0c4da9259d89672a5bc342e106 WatchSource:0}: Error finding container f195a5e1ac0616f3e43aa9b009a5e7540d7c0b0c4da9259d89672a5bc342e106: Status 404 returned error can't find the container with id f195a5e1ac0616f3e43aa9b009a5e7540d7c0b0c4da9259d89672a5bc342e106
Jul 14 16:27:21.132590 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.132558    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xtd5m" event={"ID":"5716100f-473f-49e3-a249-bede6e678744","Type":"ContainerStarted","Data":"cd84b0d30ad8317c70467c140f6824f8d266d47997c43905ca45239ef45eaa76"}
Jul 14 16:27:21.133788 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.133760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv" event={"ID":"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f","Type":"ContainerStarted","Data":"cf3b4251aef2a046da02360c31928d303d6f3971f4d11c98c90a75c8ba81a417"}
Jul 14 16:27:21.136005 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.135979    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s7tn4" event={"ID":"ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc","Type":"ContainerStarted","Data":"0db749c17429f790789fac028c6fbf95b8794ee5dfe2117d0dd0e207917c5c54"}
Jul 14 16:27:21.137524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.137504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg" event={"ID":"7f5588b0-0938-4f61-9b0d-b593c368af43","Type":"ContainerStarted","Data":"efa801297c839765022aa4436e6aa50462c82c6effa30d6c3efb0f32261f9e8f"}
Jul 14 16:27:21.137605 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.137542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg" event={"ID":"7f5588b0-0938-4f61-9b0d-b593c368af43","Type":"ContainerStarted","Data":"4f971dd57f9a2f2ffc87495e598da3d6f648311c3434b6f2c436a072b6a58aa2"}
Jul 14 16:27:21.137605 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.137561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg" event={"ID":"7f5588b0-0938-4f61-9b0d-b593c368af43","Type":"ContainerStarted","Data":"f195a5e1ac0616f3e43aa9b009a5e7540d7c0b0c4da9259d89672a5bc342e106"}
Jul 14 16:27:21.158274 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.158199    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s7tn4" podStartSLOduration=1.914508264 podStartE2EDuration="12.158185696s" totalImagesPullingTime="10.243677432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:27:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:21.156871532 +0000 UTC m=+63.881500233" watchObservedRunningTime="2026-07-14 16:27:21.158185696 +0000 UTC m=+63.882814397"
Jul 14 16:27:21.347536 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.347472    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:21.347536 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.347524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:21.353549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.353520    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:21.451428 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.449904    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:27:21.452684 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.452661    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.455592 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.455568    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 16:27:21.455838 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.455814    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 16:27:21.456193 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456173    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-86vb4\""
Jul 14 16:27:21.456441 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456420    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 16:27:21.456441 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456431    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 16:27:21.456587 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456461    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 16:27:21.456587 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456474    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 16:27:21.456587 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456427    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 16:27:21.456768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456744    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 16:27:21.456832 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.456780    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 16:27:21.475984 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.475958    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:27:21.556347 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556511 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556358    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556511 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556511 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556511 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556548    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556585    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ngnh\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-kube-api-access-5ngnh\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556697    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-web-config\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.556765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.557085 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.556773    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-out\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657184 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657291    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657342 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngnh\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-kube-api-access-5ngnh\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657408    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-web-config\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-out\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657564 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.657900 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.657569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.658328 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.658295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.659040 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.659001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.662898 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.661971    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-web-config\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.662898 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.662798    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.663593 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.663548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.663699 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.663618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.663759 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.663697    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-volume\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.664028 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.663940    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-out\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.664028 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.663961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.664189 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.664140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.664475 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.664452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.667514 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.667490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.670265 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.670214    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ngnh\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-kube-api-access-5ngnh\") pod \"alertmanager-main-0\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.765185 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.765104    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:27:21.922452 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:21.922411    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:27:22.118295 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:22.118265    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf3f45c4_77bb_4f9c_baca_33cd49c5b65d.slice/crio-603f72a4c26282bb2292311631380e203c00f109f6b639de18a133af9f33e031 WatchSource:0}: Error finding container 603f72a4c26282bb2292311631380e203c00f109f6b639de18a133af9f33e031: Status 404 returned error can't find the container with id 603f72a4c26282bb2292311631380e203c00f109f6b639de18a133af9f33e031
Jul 14 16:27:22.146403 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:22.146372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"603f72a4c26282bb2292311631380e203c00f109f6b639de18a133af9f33e031"}
Jul 14 16:27:22.150943 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:22.150920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:27:23.151781 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.151739    2562 generic.go:356] "Generic (PLEG): container finished" podID="5716100f-473f-49e3-a249-bede6e678744" containerID="28f98dd8bc10a59f73d03444ee28f462fa75cff554a9c94e943f53e2d96598f2" exitCode=0
Jul 14 16:27:23.152210 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.151836    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xtd5m" event={"ID":"5716100f-473f-49e3-a249-bede6e678744","Type":"ContainerDied","Data":"28f98dd8bc10a59f73d03444ee28f462fa75cff554a9c94e943f53e2d96598f2"}
Jul 14 16:27:23.154845 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.154289    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv" event={"ID":"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f","Type":"ContainerStarted","Data":"02e04f8def3404131e2bd36aca1db219e68beeb9fc18202e953a3642ea6b1a31"}
Jul 14 16:27:23.154845 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.154355    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv" event={"ID":"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f","Type":"ContainerStarted","Data":"fdde9b70285c368deffb2912acf470a930a76c4925f534804cfed14571682baa"}
Jul 14 16:27:23.154845 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.154380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv" event={"ID":"7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f","Type":"ContainerStarted","Data":"7613ff950e4aee86ee8a2e729b853f8d7af7b37b539abf080020ce8fe6c2253b"}
Jul 14 16:27:23.156675 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.156628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg" event={"ID":"7f5588b0-0938-4f61-9b0d-b593c368af43","Type":"ContainerStarted","Data":"d79a001f4ef268e543236a557c33de322c4c885f612890b72c47b48da2f523bb"}
Jul 14 16:27:23.204282 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.204231    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-m94mg" podStartSLOduration=1.788787651 podStartE2EDuration="3.204218903s" totalImagesPullingTime="1.415431252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:23.203302224 +0000 UTC m=+65.927930926" watchObservedRunningTime="2026-07-14 16:27:23.204218903 +0000 UTC m=+65.928847603"
Jul 14 16:27:23.228385 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.228338    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-j5qhv" podStartSLOduration=1.713347237 podStartE2EDuration="3.22832616s" totalImagesPullingTime="1.514978923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:23.227027611 +0000 UTC m=+65.951656313" watchObservedRunningTime="2026-07-14 16:27:23.22832616 +0000 UTC m=+65.952954880"
Jul 14 16:27:23.375242 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.375098    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58ccf5b798-7954g"]
Jul 14 16:27:23.378335 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.378316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.390390 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.390366    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 14 16:27:23.390491 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.390384    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 14 16:27:23.390491 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.390425    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 14 16:27:23.390491 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.390366    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 14 16:27:23.390730 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.390715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 14 16:27:23.390876 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.390858    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-58k5l\""
Jul 14 16:27:23.391170 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.391153    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fdn725ed69s6l\""
Jul 14 16:27:23.413302 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.413247    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58ccf5b798-7954g"]
Jul 14 16:27:23.474613 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-metrics-client-ca\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52zq2\" (UniqueName: \"kubernetes.io/projected/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-kube-api-access-52zq2\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474818 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474818 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474892 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474892 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:23.474971 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-grpc-tls\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.474971 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.474943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-tls\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.477915 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.477896    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 14 16:27:23.487195 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.487174    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/893092ff-b1fb-40d0-bbed-d3f22c587217-metrics-certs\") pod \"network-metrics-daemon-59gvw\" (UID: \"893092ff-b1fb-40d0-bbed-d3f22c587217\") " pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:23.575466 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575562 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-metrics-client-ca\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575562 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52zq2\" (UniqueName: \"kubernetes.io/projected/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-kube-api-access-52zq2\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575562 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:23.575562 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:23.575852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-grpc-tls\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.575852 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.575718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-tls\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.576287 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.576265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-metrics-client-ca\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.578183 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.578162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.578593 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.578516    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 14 16:27:23.578593 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.578519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.578593 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.578579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 14 16:27:23.578780 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.578599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.578780 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.578667    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.579146 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.579126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-thanos-querier-tls\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.579190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.579172    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-secret-grpc-tls\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.584694 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.584671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52zq2\" (UniqueName: \"kubernetes.io/projected/a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb-kube-api-access-52zq2\") pod \"thanos-querier-58ccf5b798-7954g\" (UID: \"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb\") " pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.588347 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.588325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37-original-pull-secret\") pod \"global-pull-secret-syncer-ns64l\" (UID: \"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37\") " pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:23.591194 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.591177    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 14 16:27:23.598664 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.598617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l76zx\" (UniqueName: \"kubernetes.io/projected/936e4a9c-f8bb-4332-a112-e9ae4ec31ccc-kube-api-access-l76zx\") pod \"network-check-target-7c9jx\" (UID: \"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc\") " pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:23.654960 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.654943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dnkj4\""
Jul 14 16:27:23.662261 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.662244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:23.666170 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.666155    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j4qnb\""
Jul 14 16:27:23.668454 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.668027    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ns64l"
Jul 14 16:27:23.673910 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.673892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-59gvw"
Jul 14 16:27:23.690334 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.690308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:23.847768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.847742    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ns64l"]
Jul 14 16:27:23.848580 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:23.848549    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9a1ebc_d7b4_4a0b_b765_4b3fbb574f37.slice/crio-8e53a557df60721a6ca1bd35b69eb4f6194843e9246e2c1c97cbe15b2ef0c569 WatchSource:0}: Error finding container 8e53a557df60721a6ca1bd35b69eb4f6194843e9246e2c1c97cbe15b2ef0c569: Status 404 returned error can't find the container with id 8e53a557df60721a6ca1bd35b69eb4f6194843e9246e2c1c97cbe15b2ef0c569
Jul 14 16:27:23.861198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.861142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-59gvw"]
Jul 14 16:27:23.865626 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.865605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7c9jx"]
Jul 14 16:27:23.867674 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:23.867648    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893092ff_b1fb_40d0_bbed_d3f22c587217.slice/crio-a228ee1a2b3cf6b13ffca875587fc5d5161a7997f1819d3745dcc2a8ef6cc7b4 WatchSource:0}: Error finding container a228ee1a2b3cf6b13ffca875587fc5d5161a7997f1819d3745dcc2a8ef6cc7b4: Status 404 returned error can't find the container with id a228ee1a2b3cf6b13ffca875587fc5d5161a7997f1819d3745dcc2a8ef6cc7b4
Jul 14 16:27:23.868796 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:23.868773    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod936e4a9c_f8bb_4332_a112_e9ae4ec31ccc.slice/crio-4766c1ba978c87b87fa0b6083b85fc34355427ffa96aab560e5756805f5c3354 WatchSource:0}: Error finding container 4766c1ba978c87b87fa0b6083b85fc34355427ffa96aab560e5756805f5c3354: Status 404 returned error can't find the container with id 4766c1ba978c87b87fa0b6083b85fc34355427ffa96aab560e5756805f5c3354
Jul 14 16:27:23.895808 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:23.895790    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58ccf5b798-7954g"]
Jul 14 16:27:23.897339 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:23.897318    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda35a3c4b_02ba_43b7_a8a7_11aabc15d4cb.slice/crio-db091926559d8d85dc3b4efd3a7839a41ff7c5711a0acf54e7fe17d927a29153 WatchSource:0}: Error finding container db091926559d8d85dc3b4efd3a7839a41ff7c5711a0acf54e7fe17d927a29153: Status 404 returned error can't find the container with id db091926559d8d85dc3b4efd3a7839a41ff7c5711a0acf54e7fe17d927a29153
Jul 14 16:27:24.161372 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.161343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"db091926559d8d85dc3b4efd3a7839a41ff7c5711a0acf54e7fe17d927a29153"}
Jul 14 16:27:24.162568 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.162546    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7c9jx" event={"ID":"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc","Type":"ContainerStarted","Data":"4766c1ba978c87b87fa0b6083b85fc34355427ffa96aab560e5756805f5c3354"}
Jul 14 16:27:24.163614 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.163594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-59gvw" event={"ID":"893092ff-b1fb-40d0-bbed-d3f22c587217","Type":"ContainerStarted","Data":"a228ee1a2b3cf6b13ffca875587fc5d5161a7997f1819d3745dcc2a8ef6cc7b4"}
Jul 14 16:27:24.165765 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.165743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xtd5m" event={"ID":"5716100f-473f-49e3-a249-bede6e678744","Type":"ContainerStarted","Data":"e63cf83b62446a1659dedd00ba09005defd6523e9ff971bc443da5a4af72dead"}
Jul 14 16:27:24.165861 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.165787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xtd5m" event={"ID":"5716100f-473f-49e3-a249-bede6e678744","Type":"ContainerStarted","Data":"224eaefb50aa927312e522e8ef139f9a8f3a229ffe8859ffbed6f65990747450"}
Jul 14 16:27:24.167348 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.167323    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6" exitCode=0
Jul 14 16:27:24.167431 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.167346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"}
Jul 14 16:27:24.168545 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.168512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ns64l" event={"ID":"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37","Type":"ContainerStarted","Data":"8e53a557df60721a6ca1bd35b69eb4f6194843e9246e2c1c97cbe15b2ef0c569"}
Jul 14 16:27:24.188939 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.188898    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xtd5m" podStartSLOduration=2.476606592 podStartE2EDuration="4.188886352s" totalImagesPullingTime="1.614096361s" totalInitContainerRuntime="98.183399ms" isStatefulPod=true podCreationTimestamp="2026-07-14 16:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:24.187708207 +0000 UTC m=+66.912336912" watchObservedRunningTime="2026-07-14 16:27:24.188886352 +0000 UTC m=+66.913515052"
Jul 14 16:27:24.772937 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.772159    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7867cc67fd-z558f"]
Jul 14 16:27:24.775132 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.775106    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.780520 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.780496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 14 16:27:24.780791 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.780774    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 14 16:27:24.781010 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.780993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-79les7ovtvusp\""
Jul 14 16:27:24.781224 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.781208    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 14 16:27:24.781531 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.781512    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 14 16:27:24.781755 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.781736    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-sqmjh\""
Jul 14 16:27:24.791109 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.791079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7867cc67fd-z558f"]
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.902918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c09be30-9a09-43ba-9d89-bcc0b40e9322-audit-log\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.902987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-client-ca-bundle\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.903038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv9s2\" (UniqueName: \"kubernetes.io/projected/8c09be30-9a09-43ba-9d89-bcc0b40e9322-kube-api-access-nv9s2\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.903069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c09be30-9a09-43ba-9d89-bcc0b40e9322-metrics-server-audit-profiles\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.903100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c09be30-9a09-43ba-9d89-bcc0b40e9322-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.903145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-secret-metrics-server-client-certs\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:24.904016 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:24.903176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-secret-metrics-server-tls\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv9s2\" (UniqueName: \"kubernetes.io/projected/8c09be30-9a09-43ba-9d89-bcc0b40e9322-kube-api-access-nv9s2\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004485    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c09be30-9a09-43ba-9d89-bcc0b40e9322-metrics-server-audit-profiles\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c09be30-9a09-43ba-9d89-bcc0b40e9322-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004569    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-secret-metrics-server-client-certs\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-secret-metrics-server-tls\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c09be30-9a09-43ba-9d89-bcc0b40e9322-audit-log\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.004787    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-client-ca-bundle\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.006113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.006007    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c09be30-9a09-43ba-9d89-bcc0b40e9322-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.007898 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.007422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8c09be30-9a09-43ba-9d89-bcc0b40e9322-audit-log\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.007898 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.007851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8c09be30-9a09-43ba-9d89-bcc0b40e9322-metrics-server-audit-profiles\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.010343 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.010232    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-secret-metrics-server-tls\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.011549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.011503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-secret-metrics-server-client-certs\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.013080 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.013049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8c09be30-9a09-43ba-9d89-bcc0b40e9322-client-ca-bundle\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.020075 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.020052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv9s2\" (UniqueName: \"kubernetes.io/projected/8c09be30-9a09-43ba-9d89-bcc0b40e9322-kube-api-access-nv9s2\") pod \"metrics-server-7867cc67fd-z558f\" (UID: \"8c09be30-9a09-43ba-9d89-bcc0b40e9322\") " pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.092944 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.092920    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:25.099757 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.098582    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"]
Jul 14 16:27:25.106332 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.105761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.109612 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.109553    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 14 16:27:25.110149 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.110098    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wrxwx\""
Jul 14 16:27:25.115055 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.112157    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"]
Jul 14 16:27:25.184277 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.182994    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-59gvw" event={"ID":"893092ff-b1fb-40d0-bbed-d3f22c587217","Type":"ContainerStarted","Data":"0dfdfc222e0a7d52ed9412a064c1c6ff423995b461e322c352b4ec9cc995c452"}
Jul 14 16:27:25.208334 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.208180    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nllb\" (UniqueName: \"kubernetes.io/projected/59d15d4d-26ad-42ee-ac87-3e90c3d928f9-kube-api-access-2nllb\") pod \"monitoring-plugin-5f68df7f58-z8r6f\" (UID: \"59d15d4d-26ad-42ee-ac87-3e90c3d928f9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.208334 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.208266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d15d4d-26ad-42ee-ac87-3e90c3d928f9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-z8r6f\" (UID: \"59d15d4d-26ad-42ee-ac87-3e90c3d928f9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.279906 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.279876    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7867cc67fd-z558f"]
Jul 14 16:27:25.309804 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.309734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nllb\" (UniqueName: \"kubernetes.io/projected/59d15d4d-26ad-42ee-ac87-3e90c3d928f9-kube-api-access-2nllb\") pod \"monitoring-plugin-5f68df7f58-z8r6f\" (UID: \"59d15d4d-26ad-42ee-ac87-3e90c3d928f9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.310433 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.309997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d15d4d-26ad-42ee-ac87-3e90c3d928f9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-z8r6f\" (UID: \"59d15d4d-26ad-42ee-ac87-3e90c3d928f9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.314816 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.314792    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59d15d4d-26ad-42ee-ac87-3e90c3d928f9-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-z8r6f\" (UID: \"59d15d4d-26ad-42ee-ac87-3e90c3d928f9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.319932 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.319907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nllb\" (UniqueName: \"kubernetes.io/projected/59d15d4d-26ad-42ee-ac87-3e90c3d928f9-kube-api-access-2nllb\") pod \"monitoring-plugin-5f68df7f58-z8r6f\" (UID: \"59d15d4d-26ad-42ee-ac87-3e90c3d928f9\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.424469 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.424439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:25.598165 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.596481    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-655f464c76-wc9h5"]
Jul 14 16:27:25.619053 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.619028    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655f464c76-wc9h5"]
Jul 14 16:27:25.619183 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.619152    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.624823 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.624597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 14 16:27:25.625396 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.625040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 14 16:27:25.625396 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.625277    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 14 16:27:25.626695 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.625733    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-wqpdp\""
Jul 14 16:27:25.626695 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.625970    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 14 16:27:25.626695 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.626085    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 14 16:27:25.634550 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.634530    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 14 16:27:25.713219 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-federate-client-tls\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713462 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713233    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-metrics-client-ca\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713462 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713462 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713573 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713466    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-serving-certs-ca-bundle\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713573 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713495    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z95f8\" (UniqueName: \"kubernetes.io/projected/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-kube-api-access-z95f8\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713573 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713523    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-secret-telemeter-client\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.713573 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.713558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-telemeter-client-tls\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.814705 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.814863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.814863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-serving-certs-ca-bundle\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.814863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z95f8\" (UniqueName: \"kubernetes.io/projected/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-kube-api-access-z95f8\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.814863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-secret-telemeter-client\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.814863 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814846    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-telemeter-client-tls\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.815106 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814882    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-federate-client-tls\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.815106 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.814916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-metrics-client-ca\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.815537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.815499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-serving-certs-ca-bundle\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.815684 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.815551    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.815847 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.815824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-metrics-client-ca\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.818685 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.818661    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.818797 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.818744    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-federate-client-tls\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.818937 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.818916    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-secret-telemeter-client\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.820386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.820360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-telemeter-client-tls\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.823770 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.823682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z95f8\" (UniqueName: \"kubernetes.io/projected/c7375c41-8a97-4b3b-b82a-ee9c9706db1b-kube-api-access-z95f8\") pod \"telemeter-client-655f464c76-wc9h5\" (UID: \"c7375c41-8a97-4b3b-b82a-ee9c9706db1b\") " pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:25.871438 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:25.871407    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c09be30_9a09_43ba_9d89_bcc0b40e9322.slice/crio-0e37d201f687b651418b9d87fbfc0aa5c7c4075b12ff7cd60a6ce82216b175a8 WatchSource:0}: Error finding container 0e37d201f687b651418b9d87fbfc0aa5c7c4075b12ff7cd60a6ce82216b175a8: Status 404 returned error can't find the container with id 0e37d201f687b651418b9d87fbfc0aa5c7c4075b12ff7cd60a6ce82216b175a8
Jul 14 16:27:25.935151 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:25.935089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5"
Jul 14 16:27:26.022583 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.022237    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"]
Jul 14 16:27:26.031463 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:26.031435    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d15d4d_26ad_42ee_ac87_3e90c3d928f9.slice/crio-878846be56acdcf8b85ec68f905744f95ed05519fdc748973755e80c617026d0 WatchSource:0}: Error finding container 878846be56acdcf8b85ec68f905744f95ed05519fdc748973755e80c617026d0: Status 404 returned error can't find the container with id 878846be56acdcf8b85ec68f905744f95ed05519fdc748973755e80c617026d0
Jul 14 16:27:26.121692 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.121594    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-655f464c76-wc9h5"]
Jul 14 16:27:26.189563 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.189517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-59gvw" event={"ID":"893092ff-b1fb-40d0-bbed-d3f22c587217","Type":"ContainerStarted","Data":"d89d11a798462d59c3ef2949fc441c247d023bb8492681c213777d7deff0e6d1"}
Jul 14 16:27:26.191249 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.191215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f" event={"ID":"59d15d4d-26ad-42ee-ac87-3e90c3d928f9","Type":"ContainerStarted","Data":"878846be56acdcf8b85ec68f905744f95ed05519fdc748973755e80c617026d0"}
Jul 14 16:27:26.192506 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.192480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f" event={"ID":"8c09be30-9a09-43ba-9d89-bcc0b40e9322","Type":"ContainerStarted","Data":"0e37d201f687b651418b9d87fbfc0aa5c7c4075b12ff7cd60a6ce82216b175a8"}
Jul 14 16:27:26.202198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.202175    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b9db4f4c7-5rqhl"]
Jul 14 16:27:26.208913 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.208866    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-59gvw" podStartSLOduration=67.136896194 podStartE2EDuration="1m8.20884857s" totalImagesPullingTime="1.071952376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:26.207501109 +0000 UTC m=+68.932129809" watchObservedRunningTime="2026-07-14 16:27:26.20884857 +0000 UTC m=+68.933477272"
Jul 14 16:27:26.224227 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.224208    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.234238 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.233524    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9db4f4c7-5rqhl"]
Jul 14 16:27:26.248624 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:26.248598    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7375c41_8a97_4b3b_b82a_ee9c9706db1b.slice/crio-4c6b6703e335b62204759cd45438f625c19d6f935eff871af750c47420e46e2b WatchSource:0}: Error finding container 4c6b6703e335b62204759cd45438f625c19d6f935eff871af750c47420e46e2b: Status 404 returned error can't find the container with id 4c6b6703e335b62204759cd45438f625c19d6f935eff871af750c47420e46e2b
Jul 14 16:27:26.318803 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.318768    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-oauth-config\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.318900 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.318811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ts2c\" (UniqueName: \"kubernetes.io/projected/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-kube-api-access-2ts2c\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.318900 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.318886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-config\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.318991 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.318951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-oauth-serving-cert\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.319027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.318993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-trusted-ca-bundle\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.319027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.319016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-service-ca\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.319115 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.319046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-serving-cert\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420104 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420024    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-oauth-serving-cert\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420104 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420075    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-trusted-ca-bundle\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420272 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-service-ca\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420353 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-serving-cert\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420401 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-oauth-config\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420401 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ts2c\" (UniqueName: \"kubernetes.io/projected/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-kube-api-access-2ts2c\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420494 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-config\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.420854 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.420828    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-oauth-serving-cert\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.421085 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.421063    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-trusted-ca-bundle\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.421425 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.421403    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-config\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.421504 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.421454    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-service-ca\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.423259 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.423236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-oauth-config\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.423493 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.423471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-serving-cert\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.430697 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.430672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ts2c\" (UniqueName: \"kubernetes.io/projected/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-kube-api-access-2ts2c\") pod \"console-b9db4f4c7-5rqhl\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") " pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.539757 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.539714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:26.748093 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.747964    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:27:26.752422 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.752392    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.756231 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.755730    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 16:27:26.756231 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.755946    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 16:27:26.756869 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.756528    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 16:27:26.758430 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.757236    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 16:27:26.758430 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.757480    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8v96m\""
Jul 14 16:27:26.758430 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.757703    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 16:27:26.758430 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.757899    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 16:27:26.758430 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.758077    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 16:27:26.758430 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.758257    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aj1adtf6s9rdd\""
Jul 14 16:27:26.761171 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.759184    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 16:27:26.762097 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.761435    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 16:27:26.762097 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.761495    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 16:27:26.762097 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.761683    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 16:27:26.762097 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.761820    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 16:27:26.762097 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.761930    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 16:27:26.764546 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.762910    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 16:27:26.770347 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.769122    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.825947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826084    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826278    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826304    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb62v\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-kube-api-access-kb62v\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826430    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.826856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.827772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.827772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.827772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.827772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.826605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928277    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928327    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb62v\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-kube-api-access-kb62v\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928494    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.929661 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.930609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.930609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.930609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.928621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.930609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.929493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.932339 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.931739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.932339 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.931984    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.932339 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.932333    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.937440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.936542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.937440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.936968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.937440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.937150    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.938700 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.938675    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.941589 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.941483    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.941768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.941724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.943322 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.943297    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.943706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.943891    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.943989    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.943999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.944062    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb62v\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-kube-api-access-kb62v\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.944246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.944525    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.944921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.944591    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:26.946730 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:26.946652    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:27.075840 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:27.075761    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:27.200735 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:27.200598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5" event={"ID":"c7375c41-8a97-4b3b-b82a-ee9c9706db1b","Type":"ContainerStarted","Data":"4c6b6703e335b62204759cd45438f625c19d6f935eff871af750c47420e46e2b"}
Jul 14 16:27:28.127752 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:28.127698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4nvl4"
Jul 14 16:27:30.151676 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:30.151622    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:27:30.167381 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:30.167353    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b9db4f4c7-5rqhl"]
Jul 14 16:27:30.450896 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:27:30.450854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf17fa3_899d_45a1_bc94_4ce04feb56ab.slice/crio-8f46226d725f66032f2d96a87cdb78b631897dc4034352f2300161227fb926aa WatchSource:0}: Error finding container 8f46226d725f66032f2d96a87cdb78b631897dc4034352f2300161227fb926aa: Status 404 returned error can't find the container with id 8f46226d725f66032f2d96a87cdb78b631897dc4034352f2300161227fb926aa
Jul 14 16:27:31.220124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:31.220049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"7fe6a17315e5b95cc784a2926d8a1db5c38701f3c90c1d6ca82931aa2de18ff3"}
Jul 14 16:27:31.221451 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:31.221411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9db4f4c7-5rqhl" event={"ID":"5bf17fa3-899d-45a1-bc94-4ce04feb56ab","Type":"ContainerStarted","Data":"8f46226d725f66032f2d96a87cdb78b631897dc4034352f2300161227fb926aa"}
Jul 14 16:27:32.229433 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.229399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"090aa60cd7ec53b03c57ee8bb92d530d89d38104994e26a9eaa455bbd3a0cadb"}
Jul 14 16:27:32.229870 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.229474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"2bc20e87f30d604583d558f36bc0858271bd1f63d3ff84226ec88aa786047793"}
Jul 14 16:27:32.229870 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.229516    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"3b691c10557de5d99fdf77a169683a3a3d1404e6b576cbec8d0c4fb8f0c2bbae"}
Jul 14 16:27:32.230958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.230934    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7c9jx" event={"ID":"936e4a9c-f8bb-4332-a112-e9ae4ec31ccc","Type":"ContainerStarted","Data":"bde5d99d60ca404d34bdc57edfcd3016ad6430376d33103f4d6691de4f2675a0"}
Jul 14 16:27:32.231078 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.231033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:27:32.232566 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.232543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9db4f4c7-5rqhl" event={"ID":"5bf17fa3-899d-45a1-bc94-4ce04feb56ab","Type":"ContainerStarted","Data":"6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765"}
Jul 14 16:27:32.234252 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.234228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ns64l" event={"ID":"8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37","Type":"ContainerStarted","Data":"5f76989ff2fea22f74c3c7dc376125ef91d4b36bdc06db249882c1b404194fec"}
Jul 14 16:27:32.235763 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.235740    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f" event={"ID":"8c09be30-9a09-43ba-9d89-bcc0b40e9322","Type":"ContainerStarted","Data":"3e93596507e590f38c9a7d826a2290e9d1009f71aea001f5657a7309d68982f5"}
Jul 14 16:27:32.237346 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.237320    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b" exitCode=0
Jul 14 16:27:32.237436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.237394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"}
Jul 14 16:27:32.239934 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.239912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5" event={"ID":"c7375c41-8a97-4b3b-b82a-ee9c9706db1b","Type":"ContainerStarted","Data":"16345a6f78f74fe6097471e26cac0d554d6f2af1662a698382b848cc3fe18499"}
Jul 14 16:27:32.240014 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.239956    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5" event={"ID":"c7375c41-8a97-4b3b-b82a-ee9c9706db1b","Type":"ContainerStarted","Data":"3eb8da0edd88c27b108a833cde6544e97d4b3032c9a4431d738cc7565bd1f389"}
Jul 14 16:27:32.240014 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.239991    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5" event={"ID":"c7375c41-8a97-4b3b-b82a-ee9c9706db1b","Type":"ContainerStarted","Data":"b884edbd6b5cd6753be38897bc167eb984b0970e84cb9478153ab18113f7c627"}
Jul 14 16:27:32.243316 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.243295    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"}
Jul 14 16:27:32.243421 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.243362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"}
Jul 14 16:27:32.243421 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.243408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"}
Jul 14 16:27:32.243536 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.243447    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"}
Jul 14 16:27:32.243536 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.243488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"}
Jul 14 16:27:32.245273 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.245251    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f" event={"ID":"59d15d4d-26ad-42ee-ac87-3e90c3d928f9","Type":"ContainerStarted","Data":"0e7ea6b5441501397d37b7efcbc00d7ba43fa4942ad3df4d72cc8ba6c3e61756"}
Jul 14 16:27:32.245360 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.245342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:32.249781 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.249734    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7c9jx" podStartSLOduration=66.855863717 podStartE2EDuration="1m14.249717661s" totalImagesPullingTime="7.393853944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:32.248034311 +0000 UTC m=+74.972663014" watchObservedRunningTime="2026-07-14 16:27:32.249717661 +0000 UTC m=+74.974346362"
Jul 14 16:27:32.251487 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.251471    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f"
Jul 14 16:27:32.288784 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.288745    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ns64l" podStartSLOduration=66.868683177 podStartE2EDuration="1m14.288720212s" totalImagesPullingTime="7.420037035s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 16:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:32.269803966 +0000 UTC m=+74.994432667" watchObservedRunningTime="2026-07-14 16:27:32.288720212 +0000 UTC m=+75.013348915"
Jul 14 16:27:32.289221 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.289192    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b9db4f4c7-5rqhl" podStartSLOduration=6.289185608 podStartE2EDuration="6.289185608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:32.287553363 +0000 UTC m=+75.012182065" watchObservedRunningTime="2026-07-14 16:27:32.289185608 +0000 UTC m=+75.013814309"
Jul 14 16:27:32.307367 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.307309    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f" podStartSLOduration=2.910643345 podStartE2EDuration="8.307292783s" totalImagesPullingTime="5.396649438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:32.306878967 +0000 UTC m=+75.031507671" watchObservedRunningTime="2026-07-14 16:27:32.307292783 +0000 UTC m=+75.031921486"
Jul 14 16:27:32.352159 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.352119    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-z8r6f" podStartSLOduration=2.062109323 podStartE2EDuration="7.35210589s" totalImagesPullingTime="5.289996567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:32.351173853 +0000 UTC m=+75.075802547" watchObservedRunningTime="2026-07-14 16:27:32.35210589 +0000 UTC m=+75.076734613"
Jul 14 16:27:32.401122 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:32.401084    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-655f464c76-wc9h5" podStartSLOduration=2.393887795 podStartE2EDuration="7.401071454s" totalImagesPullingTime="5.007183659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:32.380526262 +0000 UTC m=+75.105154971" watchObservedRunningTime="2026-07-14 16:27:32.401071454 +0000 UTC m=+75.125700154"
Jul 14 16:27:33.241690 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.241656    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9db4f4c7-5rqhl"]
Jul 14 16:27:33.254130 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.254100    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerStarted","Data":"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"}
Jul 14 16:27:33.257170 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.257134    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"0eec951f0da7d5cb9dabbc3bdfb86985771f9c124dd96d98db8c8020b4f38b8d"}
Jul 14 16:27:33.257256 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.257204    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"5326f0c0a31e16855fbee443e09882eb960f660d40b0bfc9d8c5a8050fdd53b8"}
Jul 14 16:27:33.257256 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.257237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" event={"ID":"a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb","Type":"ContainerStarted","Data":"09bec57bb6d31782159b501a3f033abb2949fe6de9050161d754b3980ba4ff88"}
Jul 14 16:27:33.290013 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.289917    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.8693897459999995 podStartE2EDuration="12.289903096s" totalImagesPullingTime="4.406147518s" totalInitContainerRuntime="14.365832ms" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:33.287726602 +0000 UTC m=+76.012355304" watchObservedRunningTime="2026-07-14 16:27:33.289903096 +0000 UTC m=+76.014531796"
Jul 14 16:27:33.316442 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:33.316403    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g" podStartSLOduration=2.187294531 podStartE2EDuration="10.316388257s" totalImagesPullingTime="8.129093726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:33.314658577 +0000 UTC m=+76.039287279" watchObservedRunningTime="2026-07-14 16:27:33.316388257 +0000 UTC m=+76.041016961"
Jul 14 16:27:34.263501 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:34.263350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:36.274772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.274680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"}
Jul 14 16:27:36.274772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.274746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"}
Jul 14 16:27:36.274772 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.274770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"}
Jul 14 16:27:36.275175 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.274794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"}
Jul 14 16:27:36.275175 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.274823    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"}
Jul 14 16:27:36.275175 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.274859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerStarted","Data":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"}
Jul 14 16:27:36.311706 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.311602    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.8480605919999995 podStartE2EDuration="10.311579869s" totalImagesPullingTime="3.426647685s" totalInitContainerRuntime="36.871592ms" isStatefulPod=false podCreationTimestamp="2026-07-14 16:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:27:36.309995168 +0000 UTC m=+79.034623869" watchObservedRunningTime="2026-07-14 16:27:36.311579869 +0000 UTC m=+79.036208570"
Jul 14 16:27:36.540065 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:36.539982    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:27:37.076620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:37.076587    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:27:40.274331 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:40.274176    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58ccf5b798-7954g"
Jul 14 16:27:43.778144 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:43.778116    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658757f9b7-8bxdk"]
Jul 14 16:27:45.093613 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:45.093578    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:45.094044 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:45.093695    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:27:59.287811 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:27:59.287751    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b9db4f4c7-5rqhl" podUID="5bf17fa3-899d-45a1-bc94-4ce04feb56ab" containerName="console" containerID="cri-o://6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765" gracePeriod=15
Jul 14 16:28:00.054179 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.054149    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:28:00.121417 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121387    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-service-ca\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121417 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121417    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-serving-cert\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121622 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121453    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-config\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121622 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121498    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ts2c\" (UniqueName: \"kubernetes.io/projected/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-kube-api-access-2ts2c\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121622 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-oauth-config\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121622 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121568    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-trusted-ca-bundle\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121861 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121623    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-oauth-serving-cert\") pod \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\" (UID: \"5bf17fa3-899d-45a1-bc94-4ce04feb56ab\") "
Jul 14 16:28:00.121958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121933    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-service-ca" (OuterVolumeSpecName: "service-ca") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:00.122014 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.121966    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-config" (OuterVolumeSpecName: "console-config") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:00.122114 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.122092    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:00.122345 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.122112    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:00.123942 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.123919    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:00.123942 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.123934    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-kube-api-access-2ts2c" (OuterVolumeSpecName: "kube-api-access-2ts2c") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "kube-api-access-2ts2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:00.124074 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.123950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5bf17fa3-899d-45a1-bc94-4ce04feb56ab" (UID: "5bf17fa3-899d-45a1-bc94-4ce04feb56ab"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:00.222373 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222323    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-oauth-serving-cert\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.222373 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222344    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-service-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.222373 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222353    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-serving-cert\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.222373 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222360    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.222373 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222368    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ts2c\" (UniqueName: \"kubernetes.io/projected/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-kube-api-access-2ts2c\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.222568 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222377    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-console-oauth-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.222568 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.222385    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5bf17fa3-899d-45a1-bc94-4ce04feb56ab-trusted-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:00.379548 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.379518    2562 generic.go:356] "Generic (PLEG): container finished" podID="5bf17fa3-899d-45a1-bc94-4ce04feb56ab" containerID="6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765" exitCode=0
Jul 14 16:28:00.379888 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.379557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9db4f4c7-5rqhl" event={"ID":"5bf17fa3-899d-45a1-bc94-4ce04feb56ab","Type":"ContainerDied","Data":"6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765"}
Jul 14 16:28:00.379888 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.379566    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b9db4f4c7-5rqhl"
Jul 14 16:28:00.379888 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.379591    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b9db4f4c7-5rqhl" event={"ID":"5bf17fa3-899d-45a1-bc94-4ce04feb56ab","Type":"ContainerDied","Data":"8f46226d725f66032f2d96a87cdb78b631897dc4034352f2300161227fb926aa"}
Jul 14 16:28:00.379888 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.379610    2562 scope.go:117] "RemoveContainer" containerID="6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765"
Jul 14 16:28:00.388472 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.388457    2562 scope.go:117] "RemoveContainer" containerID="6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765"
Jul 14 16:28:00.388755 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:00.388735    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765\": container with ID starting with 6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765 not found: ID does not exist" containerID="6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765"
Jul 14 16:28:00.388836 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.388769    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765"} err="failed to get container status \"6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765\": rpc error: code = NotFound desc = could not find container \"6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765\": container with ID starting with 6b390e00d663805a25423ce871da2fab1d7f1de22a69b87f2a44f49a4b97e765 not found: ID does not exist"
Jul 14 16:28:00.401794 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.401769    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b9db4f4c7-5rqhl"]
Jul 14 16:28:00.405338 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:00.405320    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b9db4f4c7-5rqhl"]
Jul 14 16:28:01.847183 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:01.847148    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf17fa3-899d-45a1-bc94-4ce04feb56ab" path="/var/lib/kubelet/pods/5bf17fa3-899d-45a1-bc94-4ce04feb56ab/volumes"
Jul 14 16:28:03.260361 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:03.260328    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7c9jx"
Jul 14 16:28:05.098889 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:05.098851    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:28:05.102771 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:05.102742    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7867cc67fd-z558f"
Jul 14 16:28:08.803692 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:08.803612    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-658757f9b7-8bxdk" podUID="604e88b0-3d11-447e-8a0a-ce6aecc96d12" containerName="console" containerID="cri-o://fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477" gracePeriod=15
Jul 14 16:28:09.062283 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.062229    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:28:09.089130 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089106    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dclps\" (UniqueName: \"kubernetes.io/projected/604e88b0-3d11-447e-8a0a-ce6aecc96d12-kube-api-access-dclps\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089254 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089167    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-oauth-config\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089316 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089290    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-oauth-serving-cert\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089384 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089366    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-config\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089405    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-serving-cert\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089430    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-service-ca\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089465    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-trusted-ca-bundle\") pod \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\" (UID: \"604e88b0-3d11-447e-8a0a-ce6aecc96d12\") "
Jul 14 16:28:09.089755 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089714    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:09.089755 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.089734    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-config" (OuterVolumeSpecName: "console-config") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:09.090039 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.090011    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:09.090189 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.090166    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-service-ca" (OuterVolumeSpecName: "service-ca") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:09.091525 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.091500    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:09.091627 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.091615    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:09.091785 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.091760    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/604e88b0-3d11-447e-8a0a-ce6aecc96d12-kube-api-access-dclps" (OuterVolumeSpecName: "kube-api-access-dclps") pod "604e88b0-3d11-447e-8a0a-ce6aecc96d12" (UID: "604e88b0-3d11-447e-8a0a-ce6aecc96d12"). InnerVolumeSpecName "kube-api-access-dclps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:09.190432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190413    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.190432 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190432    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-serving-cert\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.190553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190442    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-service-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.190553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190450    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-trusted-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.190553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190458    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dclps\" (UniqueName: \"kubernetes.io/projected/604e88b0-3d11-447e-8a0a-ce6aecc96d12-kube-api-access-dclps\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.190553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190466    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/604e88b0-3d11-447e-8a0a-ce6aecc96d12-console-oauth-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.190553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.190476    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/604e88b0-3d11-447e-8a0a-ce6aecc96d12-oauth-serving-cert\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:09.419014 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.418986    2562 generic.go:356] "Generic (PLEG): container finished" podID="604e88b0-3d11-447e-8a0a-ce6aecc96d12" containerID="fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477" exitCode=0
Jul 14 16:28:09.419120 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.419027    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-658757f9b7-8bxdk"
Jul 14 16:28:09.419120 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.419078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658757f9b7-8bxdk" event={"ID":"604e88b0-3d11-447e-8a0a-ce6aecc96d12","Type":"ContainerDied","Data":"fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477"}
Jul 14 16:28:09.419188 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.419151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-658757f9b7-8bxdk" event={"ID":"604e88b0-3d11-447e-8a0a-ce6aecc96d12","Type":"ContainerDied","Data":"c32e4c7d3f3a7d42d7960099b3ebaa73bd7f4b69eae3f9b7a3825c90439c04d7"}
Jul 14 16:28:09.419188 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.419173    2562 scope.go:117] "RemoveContainer" containerID="fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477"
Jul 14 16:28:09.427982 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.427965    2562 scope.go:117] "RemoveContainer" containerID="fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477"
Jul 14 16:28:09.428236 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:09.428219    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477\": container with ID starting with fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477 not found: ID does not exist" containerID="fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477"
Jul 14 16:28:09.428277 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.428246    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477"} err="failed to get container status \"fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477\": rpc error: code = NotFound desc = could not find container \"fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477\": container with ID starting with fb84f85dd6d9992ef7e051ec2d4ff216286c4b24560635ac1abca507662a2477 not found: ID does not exist"
Jul 14 16:28:09.440759 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.440730    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-658757f9b7-8bxdk"]
Jul 14 16:28:09.443081 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.443063    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-658757f9b7-8bxdk"]
Jul 14 16:28:09.846453 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:09.846381    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="604e88b0-3d11-447e-8a0a-ce6aecc96d12" path="/var/lib/kubelet/pods/604e88b0-3d11-447e-8a0a-ce6aecc96d12/volumes"
Jul 14 16:28:27.076545 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:27.076508    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:27.096266 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:27.096244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:27.509958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:27.509931    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:40.869502 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.869464    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:28:40.870043 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.869855    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="alertmanager" containerID="cri-o://85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718" gracePeriod=120
Jul 14 16:28:40.870125 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.870046    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy" containerID="cri-o://51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38" gracePeriod=120
Jul 14 16:28:40.870210 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.870153    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-web" containerID="cri-o://658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95" gracePeriod=120
Jul 14 16:28:40.870298 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.870164    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="prom-label-proxy" containerID="cri-o://8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6" gracePeriod=120
Jul 14 16:28:40.870376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.870307    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-metric" containerID="cri-o://1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b" gracePeriod=120
Jul 14 16:28:40.870436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:40.870353    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="config-reloader" containerID="cri-o://b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d" gracePeriod=120
Jul 14 16:28:41.555926 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.555888    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6" exitCode=0
Jul 14 16:28:41.555926 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.555916    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38" exitCode=0
Jul 14 16:28:41.555926 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.555924    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d" exitCode=0
Jul 14 16:28:41.555926 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.555930    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718" exitCode=0
Jul 14 16:28:41.556187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.555965    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"}
Jul 14 16:28:41.556187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.556049    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"}
Jul 14 16:28:41.556187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.556078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"}
Jul 14 16:28:41.556187 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:41.556103    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"}
Jul 14 16:28:42.113370 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.113348    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.257951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.257883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-web\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.257951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.257917    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-tls-assets\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.257951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.257942    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.257974    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-volume\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.257999    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-main-tls\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258018    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-trusted-ca-bundle\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258038    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-web-config\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258070    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-cluster-tls-config\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258102    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-metrics-client-ca\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258142    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258175    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-out\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258584 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258219    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-main-db\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258584 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258244    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ngnh\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-kube-api-access-5ngnh\") pod \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\" (UID: \"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d\") "
Jul 14 16:28:42.258584 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.258495    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:42.259733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.259699    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:42.260297 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.260270    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:42.261735 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.261714    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:42.262128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262025    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-volume" (OuterVolumeSpecName: "config-volume") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.262128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262100    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-kube-api-access-5ngnh" (OuterVolumeSpecName: "kube-api-access-5ngnh") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "kube-api-access-5ngnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:42.262272 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262220    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.262332 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262309    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.262456 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262435    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.262513 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262458    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-out" (OuterVolumeSpecName: "config-out") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:42.262551 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.262505    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.267492 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.267471    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.272882 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.272855    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-web-config" (OuterVolumeSpecName: "web-config") pod "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" (UID: "bf3f45c4-77bb-4f9c-baca-33cd49c5b65d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:42.359325 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359301    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-volume\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359325 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359325    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-main-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359336    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359345    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-web-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359353    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-cluster-tls-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359361    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-metrics-client-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359374    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359387    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-config-out\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359399    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-alertmanager-main-db\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359407    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ngnh\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-kube-api-access-5ngnh\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359416    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359424    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-tls-assets\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.359436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.359432    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:42.562733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562675    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b" exitCode=0
Jul 14 16:28:42.562733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562702    2562 generic.go:356] "Generic (PLEG): container finished" podID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerID="658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95" exitCode=0
Jul 14 16:28:42.562864 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"}
Jul 14 16:28:42.562864 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562769    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.562864 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562818    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"}
Jul 14 16:28:42.562864 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"bf3f45c4-77bb-4f9c-baca-33cd49c5b65d","Type":"ContainerDied","Data":"603f72a4c26282bb2292311631380e203c00f109f6b639de18a133af9f33e031"}
Jul 14 16:28:42.562997 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.562871    2562 scope.go:117] "RemoveContainer" containerID="8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"
Jul 14 16:28:42.572103 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.571593    2562 scope.go:117] "RemoveContainer" containerID="1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"
Jul 14 16:28:42.585227 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.585209    2562 scope.go:117] "RemoveContainer" containerID="51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"
Jul 14 16:28:42.591360 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.591336    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:28:42.593052 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.593032    2562 scope.go:117] "RemoveContainer" containerID="658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"
Jul 14 16:28:42.595452 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.595433    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:28:42.599920 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.599904    2562 scope.go:117] "RemoveContainer" containerID="b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"
Jul 14 16:28:42.606509 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.606495    2562 scope.go:117] "RemoveContainer" containerID="85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"
Jul 14 16:28:42.613416 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.613400    2562 scope.go:117] "RemoveContainer" containerID="522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"
Jul 14 16:28:42.620198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620178    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:28:42.620382 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620364    2562 scope.go:117] "RemoveContainer" containerID="8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"
Jul 14 16:28:42.620483 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620470    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-web"
Jul 14 16:28:42.620524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620485    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-web"
Jul 14 16:28:42.620524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620493    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="prom-label-proxy"
Jul 14 16:28:42.620524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620499    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="prom-label-proxy"
Jul 14 16:28:42.620524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620508    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="init-config-reloader"
Jul 14 16:28:42.620524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620513    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="init-config-reloader"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620533    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="alertmanager"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620541    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="alertmanager"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620550    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf17fa3-899d-45a1-bc94-4ce04feb56ab" containerName="console"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620555    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf17fa3-899d-45a1-bc94-4ce04feb56ab" containerName="console"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620562    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="604e88b0-3d11-447e-8a0a-ce6aecc96d12" containerName="console"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620566    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="604e88b0-3d11-447e-8a0a-ce6aecc96d12" containerName="console"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620573    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-metric"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620578    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-metric"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620587    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="config-reloader"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620595    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="config-reloader"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620607    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620614    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.620609    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6\": container with ID starting with 8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6 not found: ID does not exist" containerID="8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620681    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-metric"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620675    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"} err="failed to get container status \"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6\": rpc error: code = NotFound desc = could not find container \"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6\": container with ID starting with 8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6 not found: ID does not exist"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620690    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="alertmanager"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620692    2562 scope.go:117] "RemoveContainer" containerID="1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620697    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="604e88b0-3d11-447e-8a0a-ce6aecc96d12" containerName="console"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620703    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy-web"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620710    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="prom-label-proxy"
Jul 14 16:28:42.620707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620717    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="config-reloader"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620723    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf17fa3-899d-45a1-bc94-4ce04feb56ab" containerName="console"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620728    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" containerName="kube-rbac-proxy"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.620900    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b\": container with ID starting with 1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b not found: ID does not exist" containerID="1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620920    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"} err="failed to get container status \"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b\": rpc error: code = NotFound desc = could not find container \"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b\": container with ID starting with 1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b not found: ID does not exist"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.620933    2562 scope.go:117] "RemoveContainer" containerID="51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.621117    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38\": container with ID starting with 51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38 not found: ID does not exist" containerID="51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621132    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"} err="failed to get container status \"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38\": rpc error: code = NotFound desc = could not find container \"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38\": container with ID starting with 51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38 not found: ID does not exist"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621143    2562 scope.go:117] "RemoveContainer" containerID="658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"
Jul 14 16:28:42.621380 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.621373    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95\": container with ID starting with 658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95 not found: ID does not exist" containerID="658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"
Jul 14 16:28:42.621689 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621395    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"} err="failed to get container status \"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95\": rpc error: code = NotFound desc = could not find container \"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95\": container with ID starting with 658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95 not found: ID does not exist"
Jul 14 16:28:42.621689 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621409    2562 scope.go:117] "RemoveContainer" containerID="b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"
Jul 14 16:28:42.621689 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.621606    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d\": container with ID starting with b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d not found: ID does not exist" containerID="b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"
Jul 14 16:28:42.621689 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621625    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"} err="failed to get container status \"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d\": rpc error: code = NotFound desc = could not find container \"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d\": container with ID starting with b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d not found: ID does not exist"
Jul 14 16:28:42.621689 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621657    2562 scope.go:117] "RemoveContainer" containerID="85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"
Jul 14 16:28:42.621876 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.621862    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718\": container with ID starting with 85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718 not found: ID does not exist" containerID="85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"
Jul 14 16:28:42.621907 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621886    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"} err="failed to get container status \"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718\": rpc error: code = NotFound desc = could not find container \"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718\": container with ID starting with 85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718 not found: ID does not exist"
Jul 14 16:28:42.621942 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.621906    2562 scope.go:117] "RemoveContainer" containerID="522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"
Jul 14 16:28:42.622141 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:42.622124    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6\": container with ID starting with 522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6 not found: ID does not exist" containerID="522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"
Jul 14 16:28:42.622184 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622146    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"} err="failed to get container status \"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6\": rpc error: code = NotFound desc = could not find container \"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6\": container with ID starting with 522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6 not found: ID does not exist"
Jul 14 16:28:42.622184 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622160    2562 scope.go:117] "RemoveContainer" containerID="8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"
Jul 14 16:28:42.622383 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622366    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6"} err="failed to get container status \"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6\": rpc error: code = NotFound desc = could not find container \"8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6\": container with ID starting with 8c7fa41a440dbe160ed917d9f50e11ef81b3d9c3ebb7b3ee678c3579d0c1b0b6 not found: ID does not exist"
Jul 14 16:28:42.622428 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622383    2562 scope.go:117] "RemoveContainer" containerID="1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"
Jul 14 16:28:42.622588 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622571    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b"} err="failed to get container status \"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b\": rpc error: code = NotFound desc = could not find container \"1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b\": container with ID starting with 1df07ed5a1514552c896e0d179d761b8130c6bd0a5c968e5920d97b57535c57b not found: ID does not exist"
Jul 14 16:28:42.622670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622591    2562 scope.go:117] "RemoveContainer" containerID="51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"
Jul 14 16:28:42.622839 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622820    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38"} err="failed to get container status \"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38\": rpc error: code = NotFound desc = could not find container \"51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38\": container with ID starting with 51d23246aa7c48dac5b99070a9f396fdafb1c3e8c21a7500d23539efea6e7a38 not found: ID does not exist"
Jul 14 16:28:42.622882 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.622840    2562 scope.go:117] "RemoveContainer" containerID="658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"
Jul 14 16:28:42.623142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623124    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95"} err="failed to get container status \"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95\": rpc error: code = NotFound desc = could not find container \"658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95\": container with ID starting with 658d9917b8780043e491ba56c4e784e0a9dff28f45466fe6ff91b6e2f4a72f95 not found: ID does not exist"
Jul 14 16:28:42.623191 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623143    2562 scope.go:117] "RemoveContainer" containerID="b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"
Jul 14 16:28:42.623392 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623365    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d"} err="failed to get container status \"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d\": rpc error: code = NotFound desc = could not find container \"b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d\": container with ID starting with b6871a049755031e2958e0b349a5fef1c82793ced9316b4233fffa2c3f40ce6d not found: ID does not exist"
Jul 14 16:28:42.623392 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623392    2562 scope.go:117] "RemoveContainer" containerID="85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"
Jul 14 16:28:42.623674 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623622    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718"} err="failed to get container status \"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718\": rpc error: code = NotFound desc = could not find container \"85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718\": container with ID starting with 85bed9f1974b026a860e1f1fecc7572a46884af940f01674c63b701ec4203718 not found: ID does not exist"
Jul 14 16:28:42.623768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623676    2562 scope.go:117] "RemoveContainer" containerID="522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"
Jul 14 16:28:42.623934 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.623916    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6"} err="failed to get container status \"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6\": rpc error: code = NotFound desc = could not find container \"522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6\": container with ID starting with 522c63f6c615babd397046651f41644971004539ce6f4935439684dbbe239eb6 not found: ID does not exist"
Jul 14 16:28:42.626752 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.624977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.627962 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.627941    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 14 16:28:42.628055 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.627998    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 14 16:28:42.628055 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628000    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 14 16:28:42.628244 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628225    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-86vb4\""
Jul 14 16:28:42.628303 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628227    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 14 16:28:42.628454 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628441    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 14 16:28:42.628515 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628442    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 14 16:28:42.628515 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628465    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 14 16:28:42.628734 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.628721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 14 16:28:42.635440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.635424    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 14 16:28:42.644708 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.644688    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:28:42.762013 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.761987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762114 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762169 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762169 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762249 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762249 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762320 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762255    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762320 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762320 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762320 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762455 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxbhx\" (UniqueName: \"kubernetes.io/projected/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-kube-api-access-hxbhx\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762455 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.762455 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.762365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.862777 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.862745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.862777 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.862780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.863019 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.862799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.863019 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.862827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.863019 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.862966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxbhx\" (UniqueName: \"kubernetes.io/projected/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-kube-api-access-hxbhx\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863102    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863132    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863223    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.863892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.864391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.864158    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.865097 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.864519    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.866299 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.866275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-config-volume\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.866516 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.866489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.866664 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.866626    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.866730 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.866627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.866908 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.866886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.867031 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.867012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.867077 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.867032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.867616 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.867600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-config-out\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.867721 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.867702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-web-config\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.871386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.871370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxbhx\" (UniqueName: \"kubernetes.io/projected/8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2-kube-api-access-hxbhx\") pod \"alertmanager-main-0\" (UID: \"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:42.935921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:42.935898    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 14 16:28:43.070524 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:43.070495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 14 16:28:43.073762 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:28:43.073735    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8729bcf9_2c8f_4d8c_9f89_73fb57e1d3c2.slice/crio-65344e2fd85741c8979657544a3e838acbdc63b250a64e9f3a68a1d1058fac10 WatchSource:0}: Error finding container 65344e2fd85741c8979657544a3e838acbdc63b250a64e9f3a68a1d1058fac10: Status 404 returned error can't find the container with id 65344e2fd85741c8979657544a3e838acbdc63b250a64e9f3a68a1d1058fac10
Jul 14 16:28:43.568225 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:43.568141    2562 generic.go:356] "Generic (PLEG): container finished" podID="8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2" containerID="e90187937f7a71fbf92cd0495cb3bf8b0ab63bb88443be1660b92c790ed62eeb" exitCode=0
Jul 14 16:28:43.568664 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:43.568234    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerDied","Data":"e90187937f7a71fbf92cd0495cb3bf8b0ab63bb88443be1660b92c790ed62eeb"}
Jul 14 16:28:43.568664 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:43.568321    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"65344e2fd85741c8979657544a3e838acbdc63b250a64e9f3a68a1d1058fac10"}
Jul 14 16:28:43.848225 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:43.848200    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf3f45c4-77bb-4f9c-baca-33cd49c5b65d" path="/var/lib/kubelet/pods/bf3f45c4-77bb-4f9c-baca-33cd49c5b65d/volumes"
Jul 14 16:28:44.583547 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.583510    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"e4a09b5974824e3928eef201e430f54a7da4d066edb050d2ac0d15336196137c"}
Jul 14 16:28:44.583924 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.583612    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"243b86ed9be9c9f02930852f11b59df9278c704ca16490ca771eef86af7a5971"}
Jul 14 16:28:44.583924 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.583661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"16ccf9a205001384ef022bb2ee80e67661e6e31952d4117cfb215059ca31e3a5"}
Jul 14 16:28:44.583924 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.583687    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"96f1cd6d2e57388c9c5b541a890b625072ac43587241a06387b08eb1523505bd"}
Jul 14 16:28:44.583924 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.583710    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"2c52d28f3509bc7513cddc8f7b9b6221a60e698c790499fa4b3f1182e8aaccb2"}
Jul 14 16:28:44.583924 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.583737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2","Type":"ContainerStarted","Data":"10e82557753c29cd3196d1a710fd5cc61efc3d32794182f6ac42113cf65f3081"}
Jul 14 16:28:44.612797 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:44.612746    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6002777630000002 podStartE2EDuration="2.61272885s" totalImagesPullingTime="0s" totalInitContainerRuntime="12.451087ms" isStatefulPod=false podCreationTimestamp="2026-07-14 16:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:28:44.611410766 +0000 UTC m=+147.336039469" watchObservedRunningTime="2026-07-14 16:28:44.61272885 +0000 UTC m=+147.337357551"
Jul 14 16:28:45.090584 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.090551    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:28:45.090890 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.090857    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="prometheus" containerID="cri-o://3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f" gracePeriod=600
Jul 14 16:28:45.091014 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.090871    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy" containerID="cri-o://ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513" gracePeriod=600
Jul 14 16:28:45.091182 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.091022    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="thanos-sidecar" containerID="cri-o://29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6" gracePeriod=600
Jul 14 16:28:45.092768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.091045    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-web" containerID="cri-o://77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b" gracePeriod=600
Jul 14 16:28:45.092768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.091051    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="config-reloader" containerID="cri-o://392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a" gracePeriod=600
Jul 14 16:28:45.092768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.091304    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-thanos" containerID="cri-o://32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555" gracePeriod=600
Jul 14 16:28:45.345576 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.345511    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.488103 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config-out\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488103 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488108    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-kubelet-serving-ca-bundle\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488140    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-tls\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488161    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-2\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488181    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488198    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-1\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488217    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-trusted-ca-bundle\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-metrics-client-certs\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488252    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-0\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488300    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-tls-assets\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.488327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488329    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-metrics-client-ca\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb62v\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-kube-api-access-kb62v\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488415    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-db\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488448    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-kube-rbac-proxy\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488485    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-thanos-prometheus-http-client-file\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488602    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-serving-certs-ca-bundle\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488624    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488662    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-grpc-tls\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488726    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-web-config\") pod \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\" (UID: \"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0\") "
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488767    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.489021 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.488782    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.489620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.489198    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.489620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.489221    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.489620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.489237    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-trusted-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.489620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.489253    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.489620 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.489470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.491357 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.490185    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.491357 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.491183    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:28:45.492102 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.492070    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.492246 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.492132    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:45.492377 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.492164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config-out" (OuterVolumeSpecName: "config-out") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:28:45.492899 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.492870    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.493059 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.493028    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.493059 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.493117    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.493386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.493365    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:45.493699 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.493675    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-kube-api-access-kb62v" (OuterVolumeSpecName: "kube-api-access-kb62v") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "kube-api-access-kb62v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:28:45.493983 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.493953    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.494288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.494257    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config" (OuterVolumeSpecName: "config") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.494350 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.494325    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.494470 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.494451    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.503520 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.503499    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-web-config" (OuterVolumeSpecName: "web-config") pod "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" (UID: "6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:28:45.589682 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589662    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589685    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589701    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-grpc-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589715    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-web-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589728    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config-out\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589740    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589755    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589768    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-metrics-client-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589781    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589793    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-tls-assets\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589804    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-config\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589816    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-configmap-metrics-client-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589829    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb62v\" (UniqueName: \"kubernetes.io/projected/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-kube-api-access-kb62v\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589841    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-prometheus-k8s-db\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589853    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-secret-kube-rbac-proxy\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.589964 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.589866    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0-thanos-prometheus-http-client-file\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:28:45.591004 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.590981    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555" exitCode=0
Jul 14 16:28:45.591004 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591002    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513" exitCode=0
Jul 14 16:28:45.591124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591010    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b" exitCode=0
Jul 14 16:28:45.591124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591018    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6" exitCode=0
Jul 14 16:28:45.591124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591024    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a" exitCode=0
Jul 14 16:28:45.591124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591032    2562 generic.go:356] "Generic (PLEG): container finished" podID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f" exitCode=0
Jul 14 16:28:45.591124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591062    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"}
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"}
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591221    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"}
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591245    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"}
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591270    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"}
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591279    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.591292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"}
Jul 14 16:28:45.591621 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.591320    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0","Type":"ContainerDied","Data":"7fe6a17315e5b95cc784a2926d8a1db5c38701f3c90c1d6ca82931aa2de18ff3"}
Jul 14 16:28:45.599869 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.599850    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.607076 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.607056    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.616599 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.616564    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.617017 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.616991    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:28:45.621776 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.621757    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:28:45.624223 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.624209    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.630857 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.630841    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.637812 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.637795    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.644367 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.644255    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.644697 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.644671    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.644803 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.644706    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"} err="failed to get container status \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist"
Jul 14 16:28:45.644803 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.644727    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.645203 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.645183    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.645276 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.645207    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"} err="failed to get container status \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist"
Jul 14 16:28:45.645276 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.645223    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.645484 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.645468    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.645527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.645491    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"} err="failed to get container status \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist"
Jul 14 16:28:45.645527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.645505    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.645830 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.645808    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.645945 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.645836    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"} err="failed to get container status \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist"
Jul 14 16:28:45.645945 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.645855    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.646126 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.646110    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.646165 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646132    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"} err="failed to get container status \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist"
Jul 14 16:28:45.646165 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646154    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.646379 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.646365    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.646418 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646382    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"} err="failed to get container status \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist"
Jul 14 16:28:45.646418 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646395    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.646519 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646457    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:28:45.646679 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:28:45.646659    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.646727 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646684    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"} err="failed to get container status \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist"
Jul 14 16:28:45.646727 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646699    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.646813 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646797    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-web"
Jul 14 16:28:45.646849 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646818    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-web"
Jul 14 16:28:45.646849 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646834    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="thanos-sidecar"
Jul 14 16:28:45.646849 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646842    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="thanos-sidecar"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646849    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-thanos"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646855    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-thanos"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646862    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646867    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646876    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="config-reloader"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646881    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="config-reloader"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646893    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="prometheus"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646899    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="prometheus"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646906    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="init-config-reloader"
Jul 14 16:28:45.646948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646914    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="init-config-reloader"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646950    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"} err="failed to get container status \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646981    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.646989    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="prometheus"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647004    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="thanos-sidecar"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647015    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647024    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-thanos"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647034    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="config-reloader"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647042    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" containerName="kube-rbac-proxy-web"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647181    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"} err="failed to get container status \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist"
Jul 14 16:28:45.647258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647195    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.647609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647432    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"} err="failed to get container status \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist"
Jul 14 16:28:45.647609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647448    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.647716 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647697    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"} err="failed to get container status \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist"
Jul 14 16:28:45.647750 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647717    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.647958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647938    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"} err="failed to get container status \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist"
Jul 14 16:28:45.647958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.647957    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.648171 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.648153    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"} err="failed to get container status \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist"
Jul 14 16:28:45.648268 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.648172    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.648414 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.648396    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"} err="failed to get container status \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist"
Jul 14 16:28:45.648414 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.648414    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.649010 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.648691    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"} err="failed to get container status \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist"
Jul 14 16:28:45.649010 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.648714    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.649177 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.649026    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"} err="failed to get container status \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist"
Jul 14 16:28:45.649177 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.649063    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.649404 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.649376    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"} err="failed to get container status \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist"
Jul 14 16:28:45.649404 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.649406    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.649725 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.649699    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"} err="failed to get container status \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist"
Jul 14 16:28:45.649810 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.649727    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.651667 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.651623    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"} err="failed to get container status \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist"
Jul 14 16:28:45.651667 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.651663    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.651911 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.651889    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"} err="failed to get container status \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist"
Jul 14 16:28:45.651968 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.651913    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.652179 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652162    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"} err="failed to get container status \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist"
Jul 14 16:28:45.652248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652179    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.652387 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652370    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"} err="failed to get container status \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist"
Jul 14 16:28:45.652449 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652386    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.652609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652590    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"} err="failed to get container status \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist"
Jul 14 16:28:45.652609 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652609    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.652719 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.653024 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652813    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"} err="failed to get container status \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist"
Jul 14 16:28:45.653024 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.652836    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.653289 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.653261    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"} err="failed to get container status \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist"
Jul 14 16:28:45.653381 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.653290    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.653586 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.653561    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"} err="failed to get container status \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist"
Jul 14 16:28:45.653586 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.653586    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.653881 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.653852    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"} err="failed to get container status \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist"
Jul 14 16:28:45.653881 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.653881    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.654137 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654114    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"} err="failed to get container status \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist"
Jul 14 16:28:45.654186 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654142    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.654403 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654383    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"} err="failed to get container status \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist"
Jul 14 16:28:45.654449 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654406    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.654601 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654584    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"} err="failed to get container status \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist"
Jul 14 16:28:45.654697 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654605    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.654853 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654836    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"} err="failed to get container status \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist"
Jul 14 16:28:45.654904 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.654854    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.655084 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655062    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"} err="failed to get container status \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist"
Jul 14 16:28:45.655144 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655087    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.655365 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655339    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"} err="failed to get container status \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist"
Jul 14 16:28:45.655437 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655365    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.655659 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655596    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"} err="failed to get container status \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist"
Jul 14 16:28:45.655659 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655623    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.655940 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655887    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"} err="failed to get container status \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist"
Jul 14 16:28:45.655940 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655911    2562 scope.go:117] "RemoveContainer" containerID="32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"
Jul 14 16:28:45.655940 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655923    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 14 16:28:45.656215 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.655985    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 14 16:28:45.656215 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656059    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 14 16:28:45.656318 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656291    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 14 16:28:45.656393 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656345    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8v96m\""
Jul 14 16:28:45.656393 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-aj1adtf6s9rdd\""
Jul 14 16:28:45.656393 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656380    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 14 16:28:45.656555 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656497    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555"} err="failed to get container status \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": rpc error: code = NotFound desc = could not find container \"32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555\": container with ID starting with 32c1b222a4df41717dc7a7d22c8ab2212a69eb48f585d3cffa9cf2210b19d555 not found: ID does not exist"
Jul 14 16:28:45.656555 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656513    2562 scope.go:117] "RemoveContainer" containerID="ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"
Jul 14 16:28:45.656687 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656577    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 14 16:28:45.656795 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656764    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513"} err="failed to get container status \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": rpc error: code = NotFound desc = could not find container \"ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513\": container with ID starting with ebd71bb89a175180e0b2ae3a8d193bc05ecfcb636b8c531c5fa5e4d56a2f4513 not found: ID does not exist"
Jul 14 16:28:45.656795 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656789    2562 scope.go:117] "RemoveContainer" containerID="77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"
Jul 14 16:28:45.656898 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656835    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 14 16:28:45.656947 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 14 16:28:45.656947 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.656913    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 14 16:28:45.657128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657075    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b"} err="failed to get container status \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": rpc error: code = NotFound desc = could not find container \"77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b\": container with ID starting with 77eb9baa0e6e807643dcdfa678b1337575e12e2c767cfa6e50eb141472d1955b not found: ID does not exist"
Jul 14 16:28:45.657225 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657131    2562 scope.go:117] "RemoveContainer" containerID="29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"
Jul 14 16:28:45.657293 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657276    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 14 16:28:45.657476 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657456    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6"} err="failed to get container status \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": rpc error: code = NotFound desc = could not find container \"29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6\": container with ID starting with 29f1371764b97e32371a31337290213576afc380a7084758d13900288eb0afe6 not found: ID does not exist"
Jul 14 16:28:45.657527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657476    2562 scope.go:117] "RemoveContainer" containerID="392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"
Jul 14 16:28:45.657778 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657747    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a"} err="failed to get container status \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": rpc error: code = NotFound desc = could not find container \"392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a\": container with ID starting with 392c91b254783b6389a913bdbe9535a32cc95caa2d1cb9104d4289e6ba98e66a not found: ID does not exist"
Jul 14 16:28:45.657778 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657773    2562 scope.go:117] "RemoveContainer" containerID="3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"
Jul 14 16:28:45.657917 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 14 16:28:45.657967 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.657941    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 14 16:28:45.658027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.658006    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f"} err="failed to get container status \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": rpc error: code = NotFound desc = could not find container \"3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f\": container with ID starting with 3df331563eb820cccbfa5e1e3c20338ead5069b379d2153d951f63616259491f not found: ID does not exist"
Jul 14 16:28:45.658125 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.658027    2562 scope.go:117] "RemoveContainer" containerID="b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"
Jul 14 16:28:45.658275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.658253    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b"} err="failed to get container status \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": rpc error: code = NotFound desc = could not find container \"b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b\": container with ID starting with b391b87eed4d0f0c7f484ff816f932ed8bb35a640b6723ad365c2bb214b8a80b not found: ID does not exist"
Jul 14 16:28:45.659829 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.659812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 14 16:28:45.661725 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.661709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 14 16:28:45.675229 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.674973    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:28:45.791946 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.791919    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792039 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.791957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792039 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.791980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792039 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792056    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9w44\" (UniqueName: \"kubernetes.io/projected/ac079e17-8f27-494b-8b90-253bfc4acad3-kube-api-access-b9w44\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac079e17-8f27-494b-8b90-253bfc4acad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac079e17-8f27-494b-8b90-253bfc4acad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792323    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-config\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.792388 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.792360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.846265 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.846234    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0" path="/var/lib/kubelet/pods/6b12ea61-3bf9-48a5-a32b-d5ea7ef1ecd0/volumes"
Jul 14 16:28:45.893306 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893281    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac079e17-8f27-494b-8b90-253bfc4acad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893404 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893311    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893404 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893334    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893404 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893357    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-config\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893404 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893596 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893596 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893701 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893750 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893800 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893800 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893903 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893903 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.893903 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9w44\" (UniqueName: \"kubernetes.io/projected/ac079e17-8f27-494b-8b90-253bfc4acad3-kube-api-access-b9w44\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894061 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894061 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.893952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894061 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac079e17-8f27-494b-8b90-253bfc4acad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894061 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894015    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894061 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894031    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894464 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894464 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894109    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894464 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894613 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.894613 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.894599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.895391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.895361    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.895775 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.895747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.896098 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.896051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.896722 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.896682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.898797 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.898651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac079e17-8f27-494b-8b90-253bfc4acad3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.898931 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.898908    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac079e17-8f27-494b-8b90-253bfc4acad3-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899084 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899065    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899143 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899066    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899305 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-config\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899387 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899281    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899387 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899387 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899373    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899491 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.899491 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.899442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac079e17-8f27-494b-8b90-253bfc4acad3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.900252 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.900232    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac079e17-8f27-494b-8b90-253bfc4acad3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.904034 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.904016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9w44\" (UniqueName: \"kubernetes.io/projected/ac079e17-8f27-494b-8b90-253bfc4acad3-kube-api-access-b9w44\") pod \"prometheus-k8s-0\" (UID: \"ac079e17-8f27-494b-8b90-253bfc4acad3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:45.963046 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:45.963025    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:28:46.101847 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:46.101827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 14 16:28:46.103742 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:28:46.103717    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac079e17_8f27_494b_8b90_253bfc4acad3.slice/crio-fbc38ed023c87d58d45beff3faa14a715d9a9f8ad2521b7e2745268f475d9e54 WatchSource:0}: Error finding container fbc38ed023c87d58d45beff3faa14a715d9a9f8ad2521b7e2745268f475d9e54: Status 404 returned error can't find the container with id fbc38ed023c87d58d45beff3faa14a715d9a9f8ad2521b7e2745268f475d9e54
Jul 14 16:28:46.598860 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:46.598791    2562 generic.go:356] "Generic (PLEG): container finished" podID="ac079e17-8f27-494b-8b90-253bfc4acad3" containerID="c5f9305e46bdfbdba952b71fc814e082445d2ff8fcc4d5b87607ba1013b660d2" exitCode=0
Jul 14 16:28:46.598860 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:46.598832    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerDied","Data":"c5f9305e46bdfbdba952b71fc814e082445d2ff8fcc4d5b87607ba1013b660d2"}
Jul 14 16:28:46.599309 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:46.598890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"fbc38ed023c87d58d45beff3faa14a715d9a9f8ad2521b7e2745268f475d9e54"}
Jul 14 16:28:47.611243 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.611201    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"7b44f02766e74f32ca89ef4f01565c581e665f7b0175ccb24c8f98048621fd14"}
Jul 14 16:28:47.611720 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.611316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"671193d3bdfaea7f8cd26dbc127a809c05b816b25e247c3443f6cb17d00c0e3d"}
Jul 14 16:28:47.611720 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.611363    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"385da93378c58f7a44fa9dbdc48ff65aaabe5bb49be6b7d8fe07e130dd0f5f3c"}
Jul 14 16:28:47.611720 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.611410    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"a0f33f6385286159b5815141da41ef717574dc0112dfdd9f46b4ecfc48b7596d"}
Jul 14 16:28:47.611720 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.611449    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"bcab009041d17fde107e35f9cb033756725bdd81e8310bf437588ebbd4dd4565"}
Jul 14 16:28:47.611720 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.611488    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac079e17-8f27-494b-8b90-253bfc4acad3","Type":"ContainerStarted","Data":"190ea8f950e0c08520ea9ac82f384a8ba47513bd1f608473a05f98fe2ecbdb5f"}
Jul 14 16:28:47.640795 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:47.640747    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.622084857 podStartE2EDuration="2.640731548s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.646691ms" isStatefulPod=false podCreationTimestamp="2026-07-14 16:28:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:28:47.637683449 +0000 UTC m=+150.362312152" watchObservedRunningTime="2026-07-14 16:28:47.640731548 +0000 UTC m=+150.365360249"
Jul 14 16:28:50.963949 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:28:50.963916    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:29:45.963785 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:29:45.963752    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:29:45.981156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:29:45.981120    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:29:46.877934 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:29:46.877896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 14 16:30:10.575150 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.575119    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"]
Jul 14 16:30:10.577512 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.577495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.580596 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.580574    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 14 16:30:10.580722 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.580683    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 14 16:30:10.580766 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.580684    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-6mwdz\""
Jul 14 16:30:10.587779 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.587750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"]
Jul 14 16:30:10.636856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.636831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzjf9\" (UniqueName: \"kubernetes.io/projected/53dc78e5-bee9-4276-a3cf-b2208a33f769-kube-api-access-qzjf9\") pod \"cert-manager-cainjector-559cdd8c87-hljnq\" (UID: \"53dc78e5-bee9-4276-a3cf-b2208a33f769\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.636971 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.636875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53dc78e5-bee9-4276-a3cf-b2208a33f769-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hljnq\" (UID: \"53dc78e5-bee9-4276-a3cf-b2208a33f769\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.737707 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.737676    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzjf9\" (UniqueName: \"kubernetes.io/projected/53dc78e5-bee9-4276-a3cf-b2208a33f769-kube-api-access-qzjf9\") pod \"cert-manager-cainjector-559cdd8c87-hljnq\" (UID: \"53dc78e5-bee9-4276-a3cf-b2208a33f769\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.737855 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.737715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53dc78e5-bee9-4276-a3cf-b2208a33f769-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hljnq\" (UID: \"53dc78e5-bee9-4276-a3cf-b2208a33f769\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.746123 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.746093    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/53dc78e5-bee9-4276-a3cf-b2208a33f769-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hljnq\" (UID: \"53dc78e5-bee9-4276-a3cf-b2208a33f769\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.746233 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.746166    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzjf9\" (UniqueName: \"kubernetes.io/projected/53dc78e5-bee9-4276-a3cf-b2208a33f769-kube-api-access-qzjf9\") pod \"cert-manager-cainjector-559cdd8c87-hljnq\" (UID: \"53dc78e5-bee9-4276-a3cf-b2208a33f769\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:10.906841 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:10.906816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"
Jul 14 16:30:11.033485 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:11.033345    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hljnq"]
Jul 14 16:30:11.036203 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:30:11.036170    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53dc78e5_bee9_4276_a3cf_b2208a33f769.slice/crio-7c4fba30a2c077a1484a4351b3533a3d03298ceae05bb5a9d56fc5649a115e14 WatchSource:0}: Error finding container 7c4fba30a2c077a1484a4351b3533a3d03298ceae05bb5a9d56fc5649a115e14: Status 404 returned error can't find the container with id 7c4fba30a2c077a1484a4351b3533a3d03298ceae05bb5a9d56fc5649a115e14
Jul 14 16:30:11.960391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:11.960356    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq" event={"ID":"53dc78e5-bee9-4276-a3cf-b2208a33f769","Type":"ContainerStarted","Data":"7c4fba30a2c077a1484a4351b3533a3d03298ceae05bb5a9d56fc5649a115e14"}
Jul 14 16:30:14.974821 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:14.974793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq" event={"ID":"53dc78e5-bee9-4276-a3cf-b2208a33f769","Type":"ContainerStarted","Data":"dda7e11d82a5efd2174644deb0d72142b1275be8d600aa2a778bc7e5e0fb650f"}
Jul 14 16:30:14.990768 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:14.990725    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hljnq" podStartSLOduration=1.7896639429999999 podStartE2EDuration="4.990710952s" totalImagesPullingTime="3.201047009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:14.989494496 +0000 UTC m=+237.714123198" watchObservedRunningTime="2026-07-14 16:30:14.990710952 +0000 UTC m=+237.715339653"
Jul 14 16:30:21.810013 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.809973    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"]
Jul 14 16:30:21.812560 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.812541    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:21.815360 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.815338    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 14 16:30:21.815472 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.815338    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6d67g\""
Jul 14 16:30:21.816626 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.816604    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 14 16:30:21.822209 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.822183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"]
Jul 14 16:30:21.931183 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.931155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feefb75a-c6af-4ec1-a238-7b1b9855b40d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nrxhx\" (UID: \"feefb75a-c6af-4ec1-a238-7b1b9855b40d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:21.931288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:21.931272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4lvj\" (UniqueName: \"kubernetes.io/projected/feefb75a-c6af-4ec1-a238-7b1b9855b40d-kube-api-access-n4lvj\") pod \"openshift-lws-operator-fd8ccff4c-nrxhx\" (UID: \"feefb75a-c6af-4ec1-a238-7b1b9855b40d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:22.031893 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:22.031867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4lvj\" (UniqueName: \"kubernetes.io/projected/feefb75a-c6af-4ec1-a238-7b1b9855b40d-kube-api-access-n4lvj\") pod \"openshift-lws-operator-fd8ccff4c-nrxhx\" (UID: \"feefb75a-c6af-4ec1-a238-7b1b9855b40d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:22.031994 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:22.031899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feefb75a-c6af-4ec1-a238-7b1b9855b40d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nrxhx\" (UID: \"feefb75a-c6af-4ec1-a238-7b1b9855b40d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:22.032216 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:22.032199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feefb75a-c6af-4ec1-a238-7b1b9855b40d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-nrxhx\" (UID: \"feefb75a-c6af-4ec1-a238-7b1b9855b40d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:22.042481 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:22.042456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4lvj\" (UniqueName: \"kubernetes.io/projected/feefb75a-c6af-4ec1-a238-7b1b9855b40d-kube-api-access-n4lvj\") pod \"openshift-lws-operator-fd8ccff4c-nrxhx\" (UID: \"feefb75a-c6af-4ec1-a238-7b1b9855b40d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:22.122288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:22.122269    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"
Jul 14 16:30:22.248527 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:22.248468    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx"]
Jul 14 16:30:22.251260 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:30:22.251234    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeefb75a_c6af_4ec1_a238_7b1b9855b40d.slice/crio-ad8b3e477dad38982386c9178bf5bdb08d4874dc91ef614205f338734d3d72a7 WatchSource:0}: Error finding container ad8b3e477dad38982386c9178bf5bdb08d4874dc91ef614205f338734d3d72a7: Status 404 returned error can't find the container with id ad8b3e477dad38982386c9178bf5bdb08d4874dc91ef614205f338734d3d72a7
Jul 14 16:30:23.012568 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:23.012531    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx" event={"ID":"feefb75a-c6af-4ec1-a238-7b1b9855b40d","Type":"ContainerStarted","Data":"ad8b3e477dad38982386c9178bf5bdb08d4874dc91ef614205f338734d3d72a7"}
Jul 14 16:30:25.023733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:25.023651    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx" event={"ID":"feefb75a-c6af-4ec1-a238-7b1b9855b40d","Type":"ContainerStarted","Data":"b103cddcd40b61798f9a96ffdd050e61dc7b6ee58aec76c4b76a4616aec93274"}
Jul 14 16:30:25.042235 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:25.042187    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-nrxhx" podStartSLOduration=1.656628406 podStartE2EDuration="4.042149917s" totalImagesPullingTime="2.385521511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:25.041176158 +0000 UTC m=+247.765804861" watchObservedRunningTime="2026-07-14 16:30:25.042149917 +0000 UTC m=+247.766778619"
Jul 14 16:30:28.868252 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:28.868222    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r4xk9"]
Jul 14 16:30:28.870534 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:28.870520    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:28.873755 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:28.873737    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-ldswb\""
Jul 14 16:30:28.890020 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:28.889998    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r4xk9"]
Jul 14 16:30:28.982889 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:28.982861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e4ca3d-4972-441e-9819-36fb4905da5a-bound-sa-token\") pod \"cert-manager-55b4d954d5-r4xk9\" (UID: \"d9e4ca3d-4972-441e-9819-36fb4905da5a\") " pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:28.983001 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:28.982932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z4j4\" (UniqueName: \"kubernetes.io/projected/d9e4ca3d-4972-441e-9819-36fb4905da5a-kube-api-access-7z4j4\") pod \"cert-manager-55b4d954d5-r4xk9\" (UID: \"d9e4ca3d-4972-441e-9819-36fb4905da5a\") " pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:29.083790 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:29.083765    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z4j4\" (UniqueName: \"kubernetes.io/projected/d9e4ca3d-4972-441e-9819-36fb4905da5a-kube-api-access-7z4j4\") pod \"cert-manager-55b4d954d5-r4xk9\" (UID: \"d9e4ca3d-4972-441e-9819-36fb4905da5a\") " pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:29.083928 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:29.083822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e4ca3d-4972-441e-9819-36fb4905da5a-bound-sa-token\") pod \"cert-manager-55b4d954d5-r4xk9\" (UID: \"d9e4ca3d-4972-441e-9819-36fb4905da5a\") " pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:29.096051 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:29.096019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d9e4ca3d-4972-441e-9819-36fb4905da5a-bound-sa-token\") pod \"cert-manager-55b4d954d5-r4xk9\" (UID: \"d9e4ca3d-4972-441e-9819-36fb4905da5a\") " pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:29.096222 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:29.096202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z4j4\" (UniqueName: \"kubernetes.io/projected/d9e4ca3d-4972-441e-9819-36fb4905da5a-kube-api-access-7z4j4\") pod \"cert-manager-55b4d954d5-r4xk9\" (UID: \"d9e4ca3d-4972-441e-9819-36fb4905da5a\") " pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:29.179211 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:29.179161    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r4xk9"
Jul 14 16:30:29.303713 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:29.303692    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r4xk9"]
Jul 14 16:30:29.306248 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:30:29.306216    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9e4ca3d_4972_441e_9819_36fb4905da5a.slice/crio-7982666fe3c6e985f08852d2ad06267948daadf153328515b9d1b91dfab33dc8 WatchSource:0}: Error finding container 7982666fe3c6e985f08852d2ad06267948daadf153328515b9d1b91dfab33dc8: Status 404 returned error can't find the container with id 7982666fe3c6e985f08852d2ad06267948daadf153328515b9d1b91dfab33dc8
Jul 14 16:30:30.045677 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:30.045625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r4xk9" event={"ID":"d9e4ca3d-4972-441e-9819-36fb4905da5a","Type":"ContainerStarted","Data":"30ef657b78de8378a65cf6f2a29824ca43f1cc757df9d4c55d1fa43dcb94a4c0"}
Jul 14 16:30:30.046050 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:30.045693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r4xk9" event={"ID":"d9e4ca3d-4972-441e-9819-36fb4905da5a","Type":"ContainerStarted","Data":"7982666fe3c6e985f08852d2ad06267948daadf153328515b9d1b91dfab33dc8"}
Jul 14 16:30:30.068367 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:30.068323    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-r4xk9" podStartSLOduration=2.068308755 podStartE2EDuration="2.068308755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:30.065567272 +0000 UTC m=+252.790195973" watchObservedRunningTime="2026-07-14 16:30:30.068308755 +0000 UTC m=+252.792937456"
Jul 14 16:30:41.740013 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.739939    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"]
Jul 14 16:30:41.742733 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.742718    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.745739 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.745704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 14 16:30:41.746113 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.746082    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 14 16:30:41.746339 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.746317    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 14 16:30:41.746339 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.746335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qzpl7\""
Jul 14 16:30:41.746502 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.746359    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 14 16:30:41.762160 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.762139    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"]
Jul 14 16:30:41.890798 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.890775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47f0b7d-a184-419b-8f1c-74e2508be8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.890921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.890809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47f0b7d-a184-419b-8f1c-74e2508be8bb-manifests\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.890921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.890837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdnzc\" (UniqueName: \"kubernetes.io/projected/b47f0b7d-a184-419b-8f1c-74e2508be8bb-kube-api-access-qdnzc\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.890921 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.890891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47f0b7d-a184-419b-8f1c-74e2508be8bb-tmp\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.891022 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.890923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47f0b7d-a184-419b-8f1c-74e2508be8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.991618 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.991561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47f0b7d-a184-419b-8f1c-74e2508be8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.991618 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.991595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47f0b7d-a184-419b-8f1c-74e2508be8bb-manifests\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.991790 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.991655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdnzc\" (UniqueName: \"kubernetes.io/projected/b47f0b7d-a184-419b-8f1c-74e2508be8bb-kube-api-access-qdnzc\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.991845 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.991809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47f0b7d-a184-419b-8f1c-74e2508be8bb-tmp\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.991887 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.991869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47f0b7d-a184-419b-8f1c-74e2508be8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.992054 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.992027    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b47f0b7d-a184-419b-8f1c-74e2508be8bb-manifests\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.993888 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.993865    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b47f0b7d-a184-419b-8f1c-74e2508be8bb-tmp\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.994080 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.994064    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b47f0b7d-a184-419b-8f1c-74e2508be8bb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:41.994241 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:41.994225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b47f0b7d-a184-419b-8f1c-74e2508be8bb-webhook-cert\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:42.005445 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:42.005426    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdnzc\" (UniqueName: \"kubernetes.io/projected/b47f0b7d-a184-419b-8f1c-74e2508be8bb-kube-api-access-qdnzc\") pod \"opendatahub-operator-controller-manager-b6f9446cf-8z9lf\" (UID: \"b47f0b7d-a184-419b-8f1c-74e2508be8bb\") " pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:42.054297 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:42.054275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:42.209784 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:42.209760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"]
Jul 14 16:30:42.211532 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:30:42.211503    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47f0b7d_a184_419b_8f1c_74e2508be8bb.slice/crio-894639a6db7a843f5aba2d2765a0b16440c3063e707f955d7a89fecce9e4d558 WatchSource:0}: Error finding container 894639a6db7a843f5aba2d2765a0b16440c3063e707f955d7a89fecce9e4d558: Status 404 returned error can't find the container with id 894639a6db7a843f5aba2d2765a0b16440c3063e707f955d7a89fecce9e4d558
Jul 14 16:30:43.105242 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:43.105194    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf" event={"ID":"b47f0b7d-a184-419b-8f1c-74e2508be8bb","Type":"ContainerStarted","Data":"894639a6db7a843f5aba2d2765a0b16440c3063e707f955d7a89fecce9e4d558"}
Jul 14 16:30:47.126958 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:47.126921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf" event={"ID":"b47f0b7d-a184-419b-8f1c-74e2508be8bb","Type":"ContainerStarted","Data":"dcef760fff66899030401758077a578243a31865fcb7242e66bfb499a505715b"}
Jul 14 16:30:48.132479 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:48.132443    2562 generic.go:356] "Generic (PLEG): container finished" podID="b47f0b7d-a184-419b-8f1c-74e2508be8bb" containerID="dcef760fff66899030401758077a578243a31865fcb7242e66bfb499a505715b" exitCode=0
Jul 14 16:30:48.132881 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:48.132505    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf" event={"ID":"b47f0b7d-a184-419b-8f1c-74e2508be8bb","Type":"ContainerDied","Data":"dcef760fff66899030401758077a578243a31865fcb7242e66bfb499a505715b"}
Jul 14 16:30:51.148305 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:51.148269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf" event={"ID":"b47f0b7d-a184-419b-8f1c-74e2508be8bb","Type":"ContainerStarted","Data":"b01d17f348a7ad0a71221d91f4194cba11178923c4a53bc2ba0f0a0abd8e335d"}
Jul 14 16:30:51.148731 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:51.148379    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:30:51.173292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:30:51.173243    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf" podStartSLOduration=3.119290316 podStartE2EDuration="10.173229593s" totalImagesPullingTime="6.034329429s" totalInitContainerRuntime="1.019609848s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:30:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:30:51.170475743 +0000 UTC m=+273.895104443" watchObservedRunningTime="2026-07-14 16:30:51.173229593 +0000 UTC m=+273.897858325"
Jul 14 16:31:00.307456 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.307427    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"]
Jul 14 16:31:00.313874 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.313852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.317106 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.317089    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qncnc\""
Jul 14 16:31:00.318424 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.318408    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 14 16:31:00.318479 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.318449    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 14 16:31:00.318548 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.318534    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 14 16:31:00.324279 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.324260    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"]
Jul 14 16:31:00.440198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.440159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8b81ecc1-55b3-4edf-b461-321748d55765-manager-config\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.440198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.440194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b81ecc1-55b3-4edf-b461-321748d55765-cert\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.440382 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.440265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlt2d\" (UniqueName: \"kubernetes.io/projected/8b81ecc1-55b3-4edf-b461-321748d55765-kube-api-access-qlt2d\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.440382 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.440286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b81ecc1-55b3-4edf-b461-321748d55765-metrics-cert\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.541652 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.541602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8b81ecc1-55b3-4edf-b461-321748d55765-manager-config\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.541802 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.541660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b81ecc1-55b3-4edf-b461-321748d55765-cert\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.541802 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.541730    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlt2d\" (UniqueName: \"kubernetes.io/projected/8b81ecc1-55b3-4edf-b461-321748d55765-kube-api-access-qlt2d\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.541802 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.541755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b81ecc1-55b3-4edf-b461-321748d55765-metrics-cert\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.542356 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.542328    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8b81ecc1-55b3-4edf-b461-321748d55765-manager-config\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.544195 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.544171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b81ecc1-55b3-4edf-b461-321748d55765-metrics-cert\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.544290 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.544224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b81ecc1-55b3-4edf-b461-321748d55765-cert\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.550031 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.550010    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlt2d\" (UniqueName: \"kubernetes.io/projected/8b81ecc1-55b3-4edf-b461-321748d55765-kube-api-access-qlt2d\") pod \"lws-controller-manager-54bc77f658-7pgmg\" (UID: \"8b81ecc1-55b3-4edf-b461-321748d55765\") " pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.623258 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.623235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:00.754930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:00.754905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"]
Jul 14 16:31:00.756895 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:31:00.756868    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b81ecc1_55b3_4edf_b461_321748d55765.slice/crio-6b97f949f344afdddc5a0809c82f47206531dd8f47de9c9c1362c01a11649eaf WatchSource:0}: Error finding container 6b97f949f344afdddc5a0809c82f47206531dd8f47de9c9c1362c01a11649eaf: Status 404 returned error can't find the container with id 6b97f949f344afdddc5a0809c82f47206531dd8f47de9c9c1362c01a11649eaf
Jul 14 16:31:01.196145 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:01.196115    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg" event={"ID":"8b81ecc1-55b3-4edf-b461-321748d55765","Type":"ContainerStarted","Data":"6b97f949f344afdddc5a0809c82f47206531dd8f47de9c9c1362c01a11649eaf"}
Jul 14 16:31:02.155717 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:02.155691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b6f9446cf-8z9lf"
Jul 14 16:31:03.206686 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:03.206648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg" event={"ID":"8b81ecc1-55b3-4edf-b461-321748d55765","Type":"ContainerStarted","Data":"b83e6036f4e96d3668d62703546572363adcabec139555ada09cfa2e436ff451"}
Jul 14 16:31:03.207033 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:03.206738    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:03.254594 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:03.254548    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg" podStartSLOduration=1.817041382 podStartE2EDuration="3.25453403s" totalImagesPullingTime="1.437492648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:03.249895424 +0000 UTC m=+285.974524126" watchObservedRunningTime="2026-07-14 16:31:03.25453403 +0000 UTC m=+285.979162797"
Jul 14 16:31:04.372111 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.372076    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"]
Jul 14 16:31:04.374522 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.374506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.379695 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.379673    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 14 16:31:04.379926 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.379814    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 14 16:31:04.380816 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.380789    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 14 16:31:04.380816 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.380795    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 14 16:31:04.381022 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.380958    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4zmf7\""
Jul 14 16:31:04.403213 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.403192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"]
Jul 14 16:31:04.478151 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.478126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9zs8\" (UniqueName: \"kubernetes.io/projected/763f3fe6-28bd-4831-a979-740c853ac812-kube-api-access-l9zs8\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.478418 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.478397    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/763f3fe6-28bd-4831-a979-740c853ac812-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.478529 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.478510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763f3fe6-28bd-4831-a979-740c853ac812-tmp\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.579856 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.579825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/763f3fe6-28bd-4831-a979-740c853ac812-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.580006 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.579878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763f3fe6-28bd-4831-a979-740c853ac812-tmp\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.580006 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.579932    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9zs8\" (UniqueName: \"kubernetes.io/projected/763f3fe6-28bd-4831-a979-740c853ac812-kube-api-access-l9zs8\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.580006 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:31:04.579979    2562 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 14 16:31:04.580110 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:31:04.580046    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/763f3fe6-28bd-4831-a979-740c853ac812-tls-certs podName:763f3fe6-28bd-4831-a979-740c853ac812 nodeName:}" failed. No retries permitted until 2026-07-14 16:31:05.080025784 +0000 UTC m=+287.804654466 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/763f3fe6-28bd-4831-a979-740c853ac812-tls-certs") pod "kube-auth-proxy-75f7bf6bc6-bz5fd" (UID: "763f3fe6-28bd-4831-a979-740c853ac812") : secret "kube-auth-proxy-tls" not found
Jul 14 16:31:04.582260 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.582236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/763f3fe6-28bd-4831-a979-740c853ac812-tmp\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:04.600618 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:04.600587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9zs8\" (UniqueName: \"kubernetes.io/projected/763f3fe6-28bd-4831-a979-740c853ac812-kube-api-access-l9zs8\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:05.084841 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:05.084807    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/763f3fe6-28bd-4831-a979-740c853ac812-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:05.087332 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:05.087313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/763f3fe6-28bd-4831-a979-740c853ac812-tls-certs\") pod \"kube-auth-proxy-75f7bf6bc6-bz5fd\" (UID: \"763f3fe6-28bd-4831-a979-740c853ac812\") " pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:05.284377 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:05.284352    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"
Jul 14 16:31:05.444783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:05.444620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd"]
Jul 14 16:31:05.447539 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:31:05.447512    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763f3fe6_28bd_4831_a979_740c853ac812.slice/crio-d9013e00f0f90c8f0fc247ee97318e74d52d4355f2d4858bbc55f434aafda40b WatchSource:0}: Error finding container d9013e00f0f90c8f0fc247ee97318e74d52d4355f2d4858bbc55f434aafda40b: Status 404 returned error can't find the container with id d9013e00f0f90c8f0fc247ee97318e74d52d4355f2d4858bbc55f434aafda40b
Jul 14 16:31:06.221691 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:06.221658    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd" event={"ID":"763f3fe6-28bd-4831-a979-740c853ac812","Type":"ContainerStarted","Data":"d9013e00f0f90c8f0fc247ee97318e74d52d4355f2d4858bbc55f434aafda40b"}
Jul 14 16:31:10.243268 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:10.243182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd" event={"ID":"763f3fe6-28bd-4831-a979-740c853ac812","Type":"ContainerStarted","Data":"8985b4bf38511466c1f976b0daacb52536923cea89006a7940021bed2dd796c0"}
Jul 14 16:31:10.263327 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:10.263281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75f7bf6bc6-bz5fd" podStartSLOduration=1.774704402 podStartE2EDuration="6.26326644s" totalImagesPullingTime="4.488562038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:10.261013649 +0000 UTC m=+292.985642353" watchObservedRunningTime="2026-07-14 16:31:10.26326644 +0000 UTC m=+292.987895140"
Jul 14 16:31:14.214360 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:14.214329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-54bc77f658-7pgmg"
Jul 14 16:31:15.477045 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.477001    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"]
Jul 14 16:31:15.479882 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.479859    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:15.483381 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.483359    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 14 16:31:15.483492 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.483420    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-df542\""
Jul 14 16:31:15.499329 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.499301    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"]
Jul 14 16:31:15.573907 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.573875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzvks\" (UniqueName: \"kubernetes.io/projected/e883019f-a78d-4509-8a71-4dbbf9a877fa-kube-api-access-hzvks\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:15.574066 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.573934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e883019f-a78d-4509-8a71-4dbbf9a877fa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:15.674495 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.674465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzvks\" (UniqueName: \"kubernetes.io/projected/e883019f-a78d-4509-8a71-4dbbf9a877fa-kube-api-access-hzvks\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:15.674624 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.674520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e883019f-a78d-4509-8a71-4dbbf9a877fa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:15.674709 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:31:15.674624    2562 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 14 16:31:15.674709 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:31:15.674708    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e883019f-a78d-4509-8a71-4dbbf9a877fa-cert podName:e883019f-a78d-4509-8a71-4dbbf9a877fa nodeName:}" failed. No retries permitted until 2026-07-14 16:31:16.174691977 +0000 UTC m=+298.899320656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e883019f-a78d-4509-8a71-4dbbf9a877fa-cert") pod "llmisvc-controller-manager-777c6bd7d5-vlz4h" (UID: "e883019f-a78d-4509-8a71-4dbbf9a877fa") : secret "llmisvc-webhook-server-cert" not found
Jul 14 16:31:15.691930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:15.691902    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzvks\" (UniqueName: \"kubernetes.io/projected/e883019f-a78d-4509-8a71-4dbbf9a877fa-kube-api-access-hzvks\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:16.179611 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:16.179566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e883019f-a78d-4509-8a71-4dbbf9a877fa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:16.182023 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:16.182002    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e883019f-a78d-4509-8a71-4dbbf9a877fa-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-vlz4h\" (UID: \"e883019f-a78d-4509-8a71-4dbbf9a877fa\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:16.390137 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:16.390114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:16.532759 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:16.532732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"]
Jul 14 16:31:16.535736 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:31:16.535693    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode883019f_a78d_4509_8a71_4dbbf9a877fa.slice/crio-5d2e00a4a0bc15a8cdb57bdebfc578500d138d4b2f2765e9d3c09368bd4608ae WatchSource:0}: Error finding container 5d2e00a4a0bc15a8cdb57bdebfc578500d138d4b2f2765e9d3c09368bd4608ae: Status 404 returned error can't find the container with id 5d2e00a4a0bc15a8cdb57bdebfc578500d138d4b2f2765e9d3c09368bd4608ae
Jul 14 16:31:17.278257 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:17.278218    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h" event={"ID":"e883019f-a78d-4509-8a71-4dbbf9a877fa","Type":"ContainerStarted","Data":"5d2e00a4a0bc15a8cdb57bdebfc578500d138d4b2f2765e9d3c09368bd4608ae"}
Jul 14 16:31:18.094936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:18.094906    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:31:18.101532 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:18.095298    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:31:18.101532 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:18.101003    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 14 16:31:22.304374 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:22.304348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h" event={"ID":"e883019f-a78d-4509-8a71-4dbbf9a877fa","Type":"ContainerStarted","Data":"d3e3fe572d2807a732796fb374a3964c7b9f020103f426560830cbbf1a50a872"}
Jul 14 16:31:22.304756 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:22.304483    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:31:22.323763 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:22.323722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h" podStartSLOduration=1.71422857 podStartE2EDuration="7.323710531s" totalImagesPullingTime="5.609481961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:31:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:31:22.322892661 +0000 UTC m=+305.047521369" watchObservedRunningTime="2026-07-14 16:31:22.323710531 +0000 UTC m=+305.048339232"
Jul 14 16:31:53.312513 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:31:53.312484    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-vlz4h"
Jul 14 16:33:47.645502 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.645428    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:33:47.648092 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.648076    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.656318 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.656299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 14 16:33:47.656457 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.656438    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bkx9\""
Jul 14 16:33:47.660694 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.660679    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 14 16:33:47.664938 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.664924    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 14 16:33:47.726869 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.726850    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:33:47.831145 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.831115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74866255-375a-4fbf-ab16-a13abcc5b37f-config-file\") pod \"limitador-limitador-54d6d988d5-d87xj\" (UID: \"74866255-375a-4fbf-ab16-a13abcc5b37f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.831271 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.831165    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkgt5\" (UniqueName: \"kubernetes.io/projected/74866255-375a-4fbf-ab16-a13abcc5b37f-kube-api-access-mkgt5\") pod \"limitador-limitador-54d6d988d5-d87xj\" (UID: \"74866255-375a-4fbf-ab16-a13abcc5b37f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.931782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.931688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74866255-375a-4fbf-ab16-a13abcc5b37f-config-file\") pod \"limitador-limitador-54d6d988d5-d87xj\" (UID: \"74866255-375a-4fbf-ab16-a13abcc5b37f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.931782 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.931740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkgt5\" (UniqueName: \"kubernetes.io/projected/74866255-375a-4fbf-ab16-a13abcc5b37f-kube-api-access-mkgt5\") pod \"limitador-limitador-54d6d988d5-d87xj\" (UID: \"74866255-375a-4fbf-ab16-a13abcc5b37f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.932352 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.932325    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/74866255-375a-4fbf-ab16-a13abcc5b37f-config-file\") pod \"limitador-limitador-54d6d988d5-d87xj\" (UID: \"74866255-375a-4fbf-ab16-a13abcc5b37f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.949220 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.949187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkgt5\" (UniqueName: \"kubernetes.io/projected/74866255-375a-4fbf-ab16-a13abcc5b37f-kube-api-access-mkgt5\") pod \"limitador-limitador-54d6d988d5-d87xj\" (UID: \"74866255-375a-4fbf-ab16-a13abcc5b37f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.958240 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.958213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:47.977879 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:47.977850    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:33:48.133156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:48.133131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:33:48.135838 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:33:48.135799    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74866255_375a_4fbf_ab16_a13abcc5b37f.slice/crio-6ae6c38100a3e5963220a6e990aecfa2d4d75293fdc27f7014a69d21e80dd637 WatchSource:0}: Error finding container 6ae6c38100a3e5963220a6e990aecfa2d4d75293fdc27f7014a69d21e80dd637: Status 404 returned error can't find the container with id 6ae6c38100a3e5963220a6e990aecfa2d4d75293fdc27f7014a69d21e80dd637
Jul 14 16:33:48.137726 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:48.137702    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:33:48.988415 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:48.988376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj" event={"ID":"74866255-375a-4fbf-ab16-a13abcc5b37f","Type":"ContainerStarted","Data":"6ae6c38100a3e5963220a6e990aecfa2d4d75293fdc27f7014a69d21e80dd637"}
Jul 14 16:33:51.000538 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:51.000498    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj" event={"ID":"74866255-375a-4fbf-ab16-a13abcc5b37f","Type":"ContainerStarted","Data":"0bb30998a8f0f663ace584ca15ff5dceee70ba22785f7128d56458f26154eb41"}
Jul 14 16:33:51.000948 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:51.000653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:33:51.046463 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:33:51.046420    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj" podStartSLOduration=1.684103916 podStartE2EDuration="4.046406851s" totalImagesPullingTime="2.362302935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:33:51.043192988 +0000 UTC m=+453.767821689" watchObservedRunningTime="2026-07-14 16:33:51.046406851 +0000 UTC m=+453.771035553"
Jul 14 16:34:02.006597 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:34:02.006570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-d87xj"
Jul 14 16:35:05.799190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:35:05.799151    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:35:26.906672 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:35:26.906611    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:35:41.191285 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:35:41.191246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:35:53.897296 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:35:53.897256    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:36:03.315894 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.315858    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"]
Jul 14 16:36:03.319247 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.319226    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.323236 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.323216    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 14 16:36:03.323375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.323299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 14 16:36:03.323375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.323331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 14 16:36:03.323375 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.323303    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-69gkh\""
Jul 14 16:36:03.329409 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.329389    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"]
Jul 14 16:36:03.417066 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.417038    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.417243 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.417083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rxqm\" (UniqueName: \"kubernetes.io/projected/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-kube-api-access-2rxqm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.417243 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.417175    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.417243 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.417201    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.417243 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.417232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.417436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.417259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.518752 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.518723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.518896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.518771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rxqm\" (UniqueName: \"kubernetes.io/projected/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-kube-api-access-2rxqm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.518896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.518809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.518896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.518827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.518896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.518853    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.518896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.518868    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.519193 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.519166    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.519257 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.519192    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.519257 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.519229    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.521219 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.521202    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.521488 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.521471    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.527688 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.527669    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rxqm\" (UniqueName: \"kubernetes.io/projected/a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d-kube-api-access-2rxqm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2\" (UID: \"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.630114 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.630086    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:03.761419 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:03.761380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"]
Jul 14 16:36:03.763660 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:36:03.763614    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5299cf0_2cc3_4dac_bec5_d7741d6e1a8d.slice/crio-b2bdc2e26ebff8572589012d663a44752f82a5024d2266352af6858ba5ee2fd7 WatchSource:0}: Error finding container b2bdc2e26ebff8572589012d663a44752f82a5024d2266352af6858ba5ee2fd7: Status 404 returned error can't find the container with id b2bdc2e26ebff8572589012d663a44752f82a5024d2266352af6858ba5ee2fd7
Jul 14 16:36:04.626465 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:04.626411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2" event={"ID":"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d","Type":"ContainerStarted","Data":"b2bdc2e26ebff8572589012d663a44752f82a5024d2266352af6858ba5ee2fd7"}
Jul 14 16:36:04.981487 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:04.981417    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:36:05.632320 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:05.632280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2" event={"ID":"a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d","Type":"ContainerStarted","Data":"8e7b5ff04d8b32d3f9193151b07a25176c64e4135c76e28d804e746b90c419b6"}
Jul 14 16:36:05.654453 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:05.654405    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2" podStartSLOduration=1.611253541 podStartE2EDuration="2.654390194s" totalImagesPullingTime="1.043136653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:36:05.65385578 +0000 UTC m=+588.378484483" watchObservedRunningTime="2026-07-14 16:36:05.654390194 +0000 UTC m=+588.379018873"
Jul 14 16:36:12.296126 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:12.296095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:36:13.630518 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:13.630484    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:13.630916 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:13.630536    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:13.642927 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:13.642910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:13.687002 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:13.686980    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2"
Jul 14 16:36:18.132063 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:18.132037    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:36:18.134391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:18.133067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:36:21.290967 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:36:21.290930    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:37:30.601196 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:37:30.601159    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:37:40.585546 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:37:40.585512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:37:51.487181 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:37:51.487150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:38:00.785212 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:38:00.785178    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:38:11.194083 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:38:11.194001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:39:20.687513 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:39:20.687479    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:39:30.685033 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:39:30.685003    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:39:39.298198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:39:39.298116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:39:48.786936 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:39:48.786902    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:39:58.480523 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:39:58.480491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:40:08.598599 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:40:08.598560    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:40:20.185080 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:40:20.185044    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:40:27.199896 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:40:27.199863    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:40:34.281217 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:40:34.281182    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:40:43.389665 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:40:43.389072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:40:58.994658 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:40:58.994610    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:41:10.986150 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:41:10.986069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:41:18.170262 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:41:18.170154    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:41:18.176912 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:41:18.170578    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:41:34.998145 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:41:34.998111    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:41:44.695195 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:41:44.695153    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:42:01.498556 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:42:01.498520    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:42:12.812289 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:42:12.812246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:42:21.996149 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:42:21.996119    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:42:31.595041 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:42:31.595008    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:42:40.222399 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:42:40.222297    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:44:31.493163 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:44:31.493129    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:44:40.091453 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:44:40.091426    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:44:52.393117 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:44:52.393084    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:45:00.147725 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.147698    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29734125-fzhwx"]
Jul 14 16:45:00.151931 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.151910    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:00.154436 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.154413    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lsszz\""
Jul 14 16:45:00.159329 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.158972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734125-fzhwx"]
Jul 14 16:45:00.219705 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.219682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5p7z\" (UniqueName: \"kubernetes.io/projected/59aa37dd-a04d-4a66-a573-218a88426f5b-kube-api-access-j5p7z\") pod \"maas-api-key-cleanup-29734125-fzhwx\" (UID: \"59aa37dd-a04d-4a66-a573-218a88426f5b\") " pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:00.320156 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.320123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5p7z\" (UniqueName: \"kubernetes.io/projected/59aa37dd-a04d-4a66-a573-218a88426f5b-kube-api-access-j5p7z\") pod \"maas-api-key-cleanup-29734125-fzhwx\" (UID: \"59aa37dd-a04d-4a66-a573-218a88426f5b\") " pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:00.331550 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.331520    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5p7z\" (UniqueName: \"kubernetes.io/projected/59aa37dd-a04d-4a66-a573-218a88426f5b-kube-api-access-j5p7z\") pod \"maas-api-key-cleanup-29734125-fzhwx\" (UID: \"59aa37dd-a04d-4a66-a573-218a88426f5b\") " pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:00.463084 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.463022    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:00.599390 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.599366    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29734125-fzhwx"]
Jul 14 16:45:00.602429 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:45:00.602400    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59aa37dd_a04d_4a66_a573_218a88426f5b.slice/crio-9944825eff657e2b3b058802341cb57d3545d3a03fc6d3c0456b9110efe94a9b WatchSource:0}: Error finding container 9944825eff657e2b3b058802341cb57d3545d3a03fc6d3c0456b9110efe94a9b: Status 404 returned error can't find the container with id 9944825eff657e2b3b058802341cb57d3545d3a03fc6d3c0456b9110efe94a9b
Jul 14 16:45:00.604884 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:00.604865    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:45:01.156010 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:01.155977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx" event={"ID":"59aa37dd-a04d-4a66-a573-218a88426f5b","Type":"ContainerStarted","Data":"9944825eff657e2b3b058802341cb57d3545d3a03fc6d3c0456b9110efe94a9b"}
Jul 14 16:45:03.168041 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:03.168008    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx" event={"ID":"59aa37dd-a04d-4a66-a573-218a88426f5b","Type":"ContainerStarted","Data":"5fce5790177ea06cee56cc10c0b7441c46cf930d30b48640e8fb9713f8dccadf"}
Jul 14 16:45:03.185982 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:03.185933    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx" podStartSLOduration=1.079241028 podStartE2EDuration="3.185919179s" totalImagesPullingTime="2.106678151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:45:03.184520869 +0000 UTC m=+1125.909149571" watchObservedRunningTime="2026-07-14 16:45:03.185919179 +0000 UTC m=+1125.910547880"
Jul 14 16:45:04.173886 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:04.173849    2562 generic.go:356] "Generic (PLEG): container finished" podID="59aa37dd-a04d-4a66-a573-218a88426f5b" containerID="5fce5790177ea06cee56cc10c0b7441c46cf930d30b48640e8fb9713f8dccadf" exitCode=0
Jul 14 16:45:04.174275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:04.173941    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx" event={"ID":"59aa37dd-a04d-4a66-a573-218a88426f5b","Type":"ContainerDied","Data":"5fce5790177ea06cee56cc10c0b7441c46cf930d30b48640e8fb9713f8dccadf"}
Jul 14 16:45:04.501350 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:04.501267    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:45:05.306137 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:05.306112    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:05.367680 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:05.367653    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5p7z\" (UniqueName: \"kubernetes.io/projected/59aa37dd-a04d-4a66-a573-218a88426f5b-kube-api-access-j5p7z\") pod \"59aa37dd-a04d-4a66-a573-218a88426f5b\" (UID: \"59aa37dd-a04d-4a66-a573-218a88426f5b\") "
Jul 14 16:45:05.369866 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:05.369844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59aa37dd-a04d-4a66-a573-218a88426f5b-kube-api-access-j5p7z" (OuterVolumeSpecName: "kube-api-access-j5p7z") pod "59aa37dd-a04d-4a66-a573-218a88426f5b" (UID: "59aa37dd-a04d-4a66-a573-218a88426f5b"). InnerVolumeSpecName "kube-api-access-j5p7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:45:05.468530 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:05.468460    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5p7z\" (UniqueName: \"kubernetes.io/projected/59aa37dd-a04d-4a66-a573-218a88426f5b-kube-api-access-j5p7z\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:45:06.185568 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:06.185540    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx"
Jul 14 16:45:06.185763 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:06.185576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29734125-fzhwx" event={"ID":"59aa37dd-a04d-4a66-a573-218a88426f5b","Type":"ContainerDied","Data":"9944825eff657e2b3b058802341cb57d3545d3a03fc6d3c0456b9110efe94a9b"}
Jul 14 16:45:06.185763 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:06.185682    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9944825eff657e2b3b058802341cb57d3545d3a03fc6d3c0456b9110efe94a9b"
Jul 14 16:45:15.983284 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:15.983252    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:45:26.382584 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:26.382550    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:45:34.887055 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:34.887025    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:45:46.110459 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:46.110387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:45:55.791623 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:45:55.791589    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:46:06.483280 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:06.483246    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:46:16.302648 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:16.302606    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:46:18.203811 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:18.203711    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:46:18.208032 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:18.205649    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:46:38.797625 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:38.797595    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:46:48.016830 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:48.016801    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:46:56.992315 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:46:56.992275    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:47:08.289917 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:47:08.289877    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:47:24.011180 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:47:24.011143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:47:34.792894 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:47:34.792858    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:47:43.894578 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:47:43.894543    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:47:53.589000 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:47:53.588962    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:48:02.563233 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:48:02.563195    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:48:14.255668 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:48:14.255615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:48:27.124448 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:48:27.124413    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:48:35.804986 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:48:35.804948    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:48:45.255215 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:48:45.255134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:48:56.796873 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:48:56.796840    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:49:08.895478 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:49:08.895441    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:49:17.418967 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:49:17.418931    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:49:28.685817 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:49:28.685780    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:49:38.187551 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:49:38.187511    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:49:47.107006 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:49:47.106972    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:49:54.682087 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:49:54.682052    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:50:07.498207 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:50:07.498170    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:50:15.981778 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:50:15.981703    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:50:24.989497 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:50:24.989458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:51:18.234440 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:51:18.234340    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:51:18.238254 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:51:18.236029    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:52:33.023162 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:52:33.023128    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:52:40.684941 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:52:40.684908    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:52:49.524335 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:52:49.524292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:52:59.110319 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:52:59.110279    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:53:08.299297 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:08.299264    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:53:40.802322 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:40.802289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:53:49.509787 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.509752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"]
Jul 14 16:53:49.510168 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.510159    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59aa37dd-a04d-4a66-a573-218a88426f5b" containerName="cleanup"
Jul 14 16:53:49.510210 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.510173    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="59aa37dd-a04d-4a66-a573-218a88426f5b" containerName="cleanup"
Jul 14 16:53:49.510285 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.510271    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="59aa37dd-a04d-4a66-a573-218a88426f5b" containerName="cleanup"
Jul 14 16:53:49.513228 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.513211    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.517510 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.517453    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c316bd01\"/\"default-dockercfg-977bs\""
Jul 14 16:53:49.517510 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.517491    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c316bd01\"/\"openshift-service-ca.crt\""
Jul 14 16:53:49.517510 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.517501    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-c316bd01\"/\"e2e-lifecycle-model-c316bd01-kserve-self-signed-certs\""
Jul 14 16:53:49.517832 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.517541    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-c316bd01\"/\"kube-root-ca.crt\""
Jul 14 16:53:49.526099 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.526077    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"]
Jul 14 16:53:49.585084 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.585060    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t2l6\" (UniqueName: \"kubernetes.io/projected/d047b9bf-d5d3-4036-87bc-00fcb5815a87-kube-api-access-8t2l6\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.585198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.585099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-model-cache\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.585198 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.585185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tmp-dir\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.585292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.585254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-home\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.585292 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.585284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-dshm\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.585356 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.585311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tls-certs\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686434 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tmp-dir\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686540 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-home\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686540 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-dshm\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686540 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tls-certs\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686746 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t2l6\" (UniqueName: \"kubernetes.io/projected/d047b9bf-d5d3-4036-87bc-00fcb5815a87-kube-api-access-8t2l6\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686746 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-model-cache\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686984 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686949    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-home\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.686984 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.686978    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tmp-dir\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.687144 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.687005    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-model-cache\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.689289 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.689266    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-dshm\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.689670 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.689649    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tls-certs\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.695729 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.695706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t2l6\" (UniqueName: \"kubernetes.io/projected/d047b9bf-d5d3-4036-87bc-00fcb5815a87-kube-api-access-8t2l6\") pod \"e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") " pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.822993 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.822936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:49.959441 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:49.959408    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"]
Jul 14 16:53:49.962902 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:53:49.962871    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd047b9bf_d5d3_4036_87bc_00fcb5815a87.slice/crio-e90afac6a7d4749f836d1d0657888fcacada71a82b9b7bdc2e8abe675a60d963 WatchSource:0}: Error finding container e90afac6a7d4749f836d1d0657888fcacada71a82b9b7bdc2e8abe675a60d963: Status 404 returned error can't find the container with id e90afac6a7d4749f836d1d0657888fcacada71a82b9b7bdc2e8abe675a60d963
Jul 14 16:53:50.691530 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:50.691485    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" event={"ID":"d047b9bf-d5d3-4036-87bc-00fcb5815a87","Type":"ContainerStarted","Data":"b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898"}
Jul 14 16:53:50.691963 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:50.691542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" event={"ID":"d047b9bf-d5d3-4036-87bc-00fcb5815a87","Type":"ContainerStarted","Data":"e90afac6a7d4749f836d1d0657888fcacada71a82b9b7bdc2e8abe675a60d963"}
Jul 14 16:53:50.717231 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:50.717184    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" podStartSLOduration=1.717169813 podStartE2EDuration="1.717169813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:53:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:53:50.716061653 +0000 UTC m=+1653.440690353" watchObservedRunningTime="2026-07-14 16:53:50.717169813 +0000 UTC m=+1653.441798513"
Jul 14 16:53:54.224969 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:54.224932    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:53:59.823409 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:59.823376    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:59.823797 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:59.823423    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:53:59.835712 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:53:59.835692    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:54:00.751364 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:00.751339    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:54:11.693692 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:11.693654    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:54:25.563781 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:25.563750    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"]
Jul 14 16:54:25.689225 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:25.689192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:54:40.584825 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.584711    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" podUID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" containerName="main" containerID="cri-o://b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898" gracePeriod=45
Jul 14 16:54:40.740770 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.740726    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" podUID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" containerName="main" probeResult="failure" output="Get \"https://10.134.0.32:8000/ready\": dial tcp 10.134.0.32:8000: connect: connection refused"
Jul 14 16:54:40.827874 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.827851    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:54:40.913928 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.913897    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tmp-dir\") pod \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") "
Jul 14 16:54:40.914124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.913936    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-dshm\") pod \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") "
Jul 14 16:54:40.914124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.913982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t2l6\" (UniqueName: \"kubernetes.io/projected/d047b9bf-d5d3-4036-87bc-00fcb5815a87-kube-api-access-8t2l6\") pod \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") "
Jul 14 16:54:40.914124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.913998    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tls-certs\") pod \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") "
Jul 14 16:54:40.914124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.914026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-model-cache\") pod \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") "
Jul 14 16:54:40.914124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.914045    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-home\") pod \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\" (UID: \"d047b9bf-d5d3-4036-87bc-00fcb5815a87\") "
Jul 14 16:54:40.914362 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.914223    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d047b9bf-d5d3-4036-87bc-00fcb5815a87" (UID: "d047b9bf-d5d3-4036-87bc-00fcb5815a87"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:54:40.914362 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.914332    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-model-cache" (OuterVolumeSpecName: "model-cache") pod "d047b9bf-d5d3-4036-87bc-00fcb5815a87" (UID: "d047b9bf-d5d3-4036-87bc-00fcb5815a87"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:54:40.914428 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.914358    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:54:40.914428 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.914370    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-home" (OuterVolumeSpecName: "home") pod "d047b9bf-d5d3-4036-87bc-00fcb5815a87" (UID: "d047b9bf-d5d3-4036-87bc-00fcb5815a87"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:54:40.916307 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.916285    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-dshm" (OuterVolumeSpecName: "dshm") pod "d047b9bf-d5d3-4036-87bc-00fcb5815a87" (UID: "d047b9bf-d5d3-4036-87bc-00fcb5815a87"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:54:40.916417 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.916384    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d047b9bf-d5d3-4036-87bc-00fcb5815a87-kube-api-access-8t2l6" (OuterVolumeSpecName: "kube-api-access-8t2l6") pod "d047b9bf-d5d3-4036-87bc-00fcb5815a87" (UID: "d047b9bf-d5d3-4036-87bc-00fcb5815a87"). InnerVolumeSpecName "kube-api-access-8t2l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:54:40.916456 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.916429    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d047b9bf-d5d3-4036-87bc-00fcb5815a87" (UID: "d047b9bf-d5d3-4036-87bc-00fcb5815a87"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:54:40.938003 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.937973    2562 generic.go:356] "Generic (PLEG): container finished" podID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" containerID="b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898" exitCode=0
Jul 14 16:54:40.938094 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.938019    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"
Jul 14 16:54:40.938094 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.938061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" event={"ID":"d047b9bf-d5d3-4036-87bc-00fcb5815a87","Type":"ContainerDied","Data":"b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898"}
Jul 14 16:54:40.938162 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.938114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv" event={"ID":"d047b9bf-d5d3-4036-87bc-00fcb5815a87","Type":"ContainerDied","Data":"e90afac6a7d4749f836d1d0657888fcacada71a82b9b7bdc2e8abe675a60d963"}
Jul 14 16:54:40.938162 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.938131    2562 scope.go:117] "RemoveContainer" containerID="b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898"
Jul 14 16:54:40.946991 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.946975    2562 scope.go:117] "RemoveContainer" containerID="b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898"
Jul 14 16:54:40.947228 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:54:40.947210    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898\": container with ID starting with b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898 not found: ID does not exist" containerID="b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898"
Jul 14 16:54:40.947271 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.947234    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898"} err="failed to get container status \"b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898\": rpc error: code = NotFound desc = could not find container \"b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898\": container with ID starting with b0add0ca268fc12bc788111c17ef1f935b04d3aa52d4967f87c476ffb9704898 not found: ID does not exist"
Jul 14 16:54:40.962649 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.962607    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"]
Jul 14 16:54:40.967724 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:40.967704    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-c316bd01/e2e-lifecycle-model-c316bd01-kserve-5974cf98cf-cgwwv"]
Jul 14 16:54:41.015387 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:41.015366    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:54:41.015387 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:41.015387    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:54:41.015529 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:41.015395    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d047b9bf-d5d3-4036-87bc-00fcb5815a87-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:54:41.015529 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:41.015404    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t2l6\" (UniqueName: \"kubernetes.io/projected/d047b9bf-d5d3-4036-87bc-00fcb5815a87-kube-api-access-8t2l6\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:54:41.015529 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:41.015414    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d047b9bf-d5d3-4036-87bc-00fcb5815a87-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:54:41.848077 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:54:41.848047    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" path="/var/lib/kubelet/pods/d047b9bf-d5d3-4036-87bc-00fcb5815a87/volumes"
Jul 14 16:55:05.884486 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:55:05.884454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:55:14.512029 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:55:14.511994    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:55:25.621341 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:55:25.621307    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:56:16.685411 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:16.685376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:56:18.264366 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:18.264256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:56:18.272183 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:18.266452    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 16:56:23.636386 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.636357    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"]
Jul 14 16:56:23.636801 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.636786    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" containerName="main"
Jul 14 16:56:23.636853 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.636805    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" containerName="main"
Jul 14 16:56:23.636891 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.636864    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d047b9bf-d5d3-4036-87bc-00fcb5815a87" containerName="main"
Jul 14 16:56:23.646226 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.646201    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.649569 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.649544    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lsszz\""
Jul 14 16:56:23.649830 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.649814    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-cff2fd-serving-cert\""
Jul 14 16:56:23.655758 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.655735    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"]
Jul 14 16:56:23.707426 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.707391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-maas-api-tls\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.707586 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.707443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2dh5\" (UniqueName: \"kubernetes.io/projected/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-kube-api-access-f2dh5\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.707586 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.707564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.808176 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.808143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.808324 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.808189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-maas-api-tls\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.808324 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.808212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2dh5\" (UniqueName: \"kubernetes.io/projected/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-kube-api-access-f2dh5\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.808849 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.808820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-openshift-service-ca\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.810959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.810936    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-maas-api-tls\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.870030 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.869998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2dh5\" (UniqueName: \"kubernetes.io/projected/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-kube-api-access-f2dh5\") pod \"maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") " pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:23.958413 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:23.958345    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:24.102612 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:24.102587    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"]
Jul 14 16:56:24.104474 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:56:24.104447    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0751d4e5_44dc_4e6f_8251_e340b0b7ddfd.slice/crio-445cc816ada5f9dc5641a1f624bf6ad9c6062e75f8d727d686d05135c40ec72f WatchSource:0}: Error finding container 445cc816ada5f9dc5641a1f624bf6ad9c6062e75f8d727d686d05135c40ec72f: Status 404 returned error can't find the container with id 445cc816ada5f9dc5641a1f624bf6ad9c6062e75f8d727d686d05135c40ec72f
Jul 14 16:56:24.105899 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:24.105881    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 16:56:24.429811 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:24.429781    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q" event={"ID":"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd","Type":"ContainerStarted","Data":"445cc816ada5f9dc5641a1f624bf6ad9c6062e75f8d727d686d05135c40ec72f"}
Jul 14 16:56:27.446233 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:27.446197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q" event={"ID":"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd","Type":"ContainerStarted","Data":"3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06"}
Jul 14 16:56:27.446587 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:27.446260    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:27.464486 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:27.464439    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q" podStartSLOduration=1.786934848 podStartE2EDuration="4.464423955s" totalImagesPullingTime="2.677489107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:56:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:56:27.462447093 +0000 UTC m=+1810.187075806" watchObservedRunningTime="2026-07-14 16:56:27.464423955 +0000 UTC m=+1810.189052656"
Jul 14 16:56:30.883974 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:30.883934    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:56:33.456475 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:33.456450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:56:36.416179 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.416146    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"]
Jul 14 16:56:36.419870 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.419852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.424108 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.424087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-528a5c\"/\"test-model-528a5c-kserve-self-signed-certs\""
Jul 14 16:56:36.425282 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.425255    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-528a5c\"/\"kube-root-ca.crt\""
Jul 14 16:56:36.425397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.425259    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-528a5c\"/\"openshift-service-ca.crt\""
Jul 14 16:56:36.425397 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.425321    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-528a5c\"/\"default-dockercfg-55xzh\""
Jul 14 16:56:36.432656 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.432620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"]
Jul 14 16:56:36.524603 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.524574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-home\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.524769 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.524614    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcf2v\" (UniqueName: \"kubernetes.io/projected/bd37371d-ef4d-4825-867b-3ddf38376eb7-kube-api-access-lcf2v\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.524769 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.524676    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37371d-ef4d-4825-867b-3ddf38376eb7-tls-certs\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.524769 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.524727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-model-cache\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.524769 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.524763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-dshm\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.524905 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.524818    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-tmp-dir\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625153 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-tmp-dir\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-home\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcf2v\" (UniqueName: \"kubernetes.io/projected/bd37371d-ef4d-4825-867b-3ddf38376eb7-kube-api-access-lcf2v\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37371d-ef4d-4825-867b-3ddf38376eb7-tls-certs\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-model-cache\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625288 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-dshm\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625618 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-tmp-dir\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625618 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-home\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.625777 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.625722    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-model-cache\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.627627 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.627608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-dshm\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.627935 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.627914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37371d-ef4d-4825-867b-3ddf38376eb7-tls-certs\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.635130 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.635110    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcf2v\" (UniqueName: \"kubernetes.io/projected/bd37371d-ef4d-4825-867b-3ddf38376eb7-kube-api-access-lcf2v\") pod \"test-model-528a5c-kserve-5dd5b9ffcc-f84hr\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") " pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.729447 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.729391    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:36.866627 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:36.866602    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"]
Jul 14 16:56:36.868302 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:56:36.868270    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd37371d_ef4d_4825_867b_3ddf38376eb7.slice/crio-ebea53bf2ee98ed63c1a2a7985a3f346fa2c69172929072ec86101fb60746cf9 WatchSource:0}: Error finding container ebea53bf2ee98ed63c1a2a7985a3f346fa2c69172929072ec86101fb60746cf9: Status 404 returned error can't find the container with id ebea53bf2ee98ed63c1a2a7985a3f346fa2c69172929072ec86101fb60746cf9
Jul 14 16:56:37.496706 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:37.496670    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr" event={"ID":"bd37371d-ef4d-4825-867b-3ddf38376eb7","Type":"ContainerStarted","Data":"db3e3d9d73d0109c67eac868409040cb53dd82a243cd7968e96337840f37a2c5"}
Jul 14 16:56:37.496706 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:37.496711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr" event={"ID":"bd37371d-ef4d-4825-867b-3ddf38376eb7","Type":"ContainerStarted","Data":"ebea53bf2ee98ed63c1a2a7985a3f346fa2c69172929072ec86101fb60746cf9"}
Jul 14 16:56:37.516033 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:37.515990    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr" podStartSLOduration=1.515975895 podStartE2EDuration="1.515975895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:56:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:56:37.514011003 +0000 UTC m=+1820.238639705" watchObservedRunningTime="2026-07-14 16:56:37.515975895 +0000 UTC m=+1820.240604625"
Jul 14 16:56:43.188058 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:43.188026    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:56:46.730311 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:46.730281    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:46.730902 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:46.730549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:46.742777 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:46.742755    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:47.564125 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:47.564094    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:56:54.806792 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.806760    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"]
Jul 14 16:56:54.810443 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.810423    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:54.814714 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.814697    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cff2fd\"/\"default-dockercfg-4smv5\""
Jul 14 16:56:54.814959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.814946    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-cff2fd\"/\"test-model-cff2fd-kserve-self-signed-certs\""
Jul 14 16:56:54.815030 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.815003    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cff2fd\"/\"kube-root-ca.crt\""
Jul 14 16:56:54.815157 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.815054    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-cff2fd\"/\"openshift-service-ca.crt\""
Jul 14 16:56:54.821207 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.821187    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"]
Jul 14 16:56:54.979081 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.979051    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d51719-5800-4d17-ac92-f979214f987e-tls-certs\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:54.979247 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.979096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-home\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:54.979247 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.979121    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-model-cache\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:54.979247 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.979213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-dshm\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:54.979350 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.979284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-tmp-dir\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:54.979350 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:54.979341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx47m\" (UniqueName: \"kubernetes.io/projected/c2d51719-5800-4d17-ac92-f979214f987e-kube-api-access-zx47m\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080512 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-tmp-dir\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080512 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx47m\" (UniqueName: \"kubernetes.io/projected/c2d51719-5800-4d17-ac92-f979214f987e-kube-api-access-zx47m\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080753 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080590    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d51719-5800-4d17-ac92-f979214f987e-tls-certs\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080753 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-home\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080753 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080726    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-model-cache\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080872 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-dshm\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.080924 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.080904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-tmp-dir\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.081070 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.081048    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-home\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.081192 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.081052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-model-cache\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.083046 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.083023    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-dshm\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.083235 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.083218    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d51719-5800-4d17-ac92-f979214f987e-tls-certs\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.094914 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.094886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx47m\" (UniqueName: \"kubernetes.io/projected/c2d51719-5800-4d17-ac92-f979214f987e-kube-api-access-zx47m\") pod \"test-model-cff2fd-kserve-765d9559bc-l466s\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") " pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.120092 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.120059    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:56:55.266485 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.266460    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"]
Jul 14 16:56:55.268595 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:56:55.268561    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2d51719_5800_4d17_ac92_f979214f987e.slice/crio-6476311920d8f069642b026dc62ba54eda2f2c310f4116b7072816604ac630cb WatchSource:0}: Error finding container 6476311920d8f069642b026dc62ba54eda2f2c310f4116b7072816604ac630cb: Status 404 returned error can't find the container with id 6476311920d8f069642b026dc62ba54eda2f2c310f4116b7072816604ac630cb
Jul 14 16:56:55.597972 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.597937    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s" event={"ID":"c2d51719-5800-4d17-ac92-f979214f987e","Type":"ContainerStarted","Data":"aa06fa0edd5f3fa89c9d343fc02712ea1a0d12083923015da49709db1c702010"}
Jul 14 16:56:55.597972 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.597978    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s" event={"ID":"c2d51719-5800-4d17-ac92-f979214f987e","Type":"ContainerStarted","Data":"6476311920d8f069642b026dc62ba54eda2f2c310f4116b7072816604ac630cb"}
Jul 14 16:56:55.617504 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:56:55.617445    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s" podStartSLOduration=1.617429402 podStartE2EDuration="1.617429402s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:56:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:56:55.616720217 +0000 UTC m=+1838.341348919" watchObservedRunningTime="2026-07-14 16:56:55.617429402 +0000 UTC m=+1838.342058103"
Jul 14 16:57:03.104408 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:03.104375    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:57:05.121114 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:05.121075    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:57:05.121563 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:05.121126    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:57:05.133216 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:05.133194    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:57:05.659095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:05.659067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:57:26.633712 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:26.633678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"]
Jul 14 16:57:27.606753 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:27.606724    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"]
Jul 14 16:57:31.485040 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:31.485006    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:57:41.657049 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:41.656936    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr" podUID="bd37371d-ef4d-4825-867b-3ddf38376eb7" containerName="main" containerID="cri-o://db3e3d9d73d0109c67eac868409040cb53dd82a243cd7968e96337840f37a2c5" gracePeriod=45
Jul 14 16:57:41.825836 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:41.825807    2562 generic.go:356] "Generic (PLEG): container finished" podID="bd37371d-ef4d-4825-867b-3ddf38376eb7" containerID="db3e3d9d73d0109c67eac868409040cb53dd82a243cd7968e96337840f37a2c5" exitCode=0
Jul 14 16:57:41.825978 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:41.825851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr" event={"ID":"bd37371d-ef4d-4825-867b-3ddf38376eb7","Type":"ContainerDied","Data":"db3e3d9d73d0109c67eac868409040cb53dd82a243cd7968e96337840f37a2c5"}
Jul 14 16:57:41.898840 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:41.898816    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:57:42.001383 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001319    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-home\") pod \"bd37371d-ef4d-4825-867b-3ddf38376eb7\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") "
Jul 14 16:57:42.001383 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lcf2v\" (UniqueName: \"kubernetes.io/projected/bd37371d-ef4d-4825-867b-3ddf38376eb7-kube-api-access-lcf2v\") pod \"bd37371d-ef4d-4825-867b-3ddf38376eb7\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") "
Jul 14 16:57:42.001383 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001371    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-model-cache\") pod \"bd37371d-ef4d-4825-867b-3ddf38376eb7\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") "
Jul 14 16:57:42.001621 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001399    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-tmp-dir\") pod \"bd37371d-ef4d-4825-867b-3ddf38376eb7\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") "
Jul 14 16:57:42.001621 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001441    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37371d-ef4d-4825-867b-3ddf38376eb7-tls-certs\") pod \"bd37371d-ef4d-4825-867b-3ddf38376eb7\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") "
Jul 14 16:57:42.001621 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001490    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-dshm\") pod \"bd37371d-ef4d-4825-867b-3ddf38376eb7\" (UID: \"bd37371d-ef4d-4825-867b-3ddf38376eb7\") "
Jul 14 16:57:42.001621 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001589    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-home" (OuterVolumeSpecName: "home") pod "bd37371d-ef4d-4825-867b-3ddf38376eb7" (UID: "bd37371d-ef4d-4825-867b-3ddf38376eb7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:42.001621 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001605    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-model-cache" (OuterVolumeSpecName: "model-cache") pod "bd37371d-ef4d-4825-867b-3ddf38376eb7" (UID: "bd37371d-ef4d-4825-867b-3ddf38376eb7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:42.001901 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bd37371d-ef4d-4825-867b-3ddf38376eb7" (UID: "bd37371d-ef4d-4825-867b-3ddf38376eb7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:42.001901 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001883    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:42.001997 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001904    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:42.001997 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.001921    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:42.003709 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.003685    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-dshm" (OuterVolumeSpecName: "dshm") pod "bd37371d-ef4d-4825-867b-3ddf38376eb7" (UID: "bd37371d-ef4d-4825-867b-3ddf38376eb7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:42.003793 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.003754    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd37371d-ef4d-4825-867b-3ddf38376eb7-kube-api-access-lcf2v" (OuterVolumeSpecName: "kube-api-access-lcf2v") pod "bd37371d-ef4d-4825-867b-3ddf38376eb7" (UID: "bd37371d-ef4d-4825-867b-3ddf38376eb7"). InnerVolumeSpecName "kube-api-access-lcf2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:57:42.003844 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.003820    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd37371d-ef4d-4825-867b-3ddf38376eb7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bd37371d-ef4d-4825-867b-3ddf38376eb7" (UID: "bd37371d-ef4d-4825-867b-3ddf38376eb7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:57:42.102659 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.102619    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lcf2v\" (UniqueName: \"kubernetes.io/projected/bd37371d-ef4d-4825-867b-3ddf38376eb7-kube-api-access-lcf2v\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:42.102659 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.102660    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37371d-ef4d-4825-867b-3ddf38376eb7-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:42.102797 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.102670    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd37371d-ef4d-4825-867b-3ddf38376eb7-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:42.626887 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.626844    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s" podUID="c2d51719-5800-4d17-ac92-f979214f987e" containerName="main" containerID="cri-o://aa06fa0edd5f3fa89c9d343fc02712ea1a0d12083923015da49709db1c702010" gracePeriod=45
Jul 14 16:57:42.832725 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.832696    2562 generic.go:356] "Generic (PLEG): container finished" podID="c2d51719-5800-4d17-ac92-f979214f987e" containerID="aa06fa0edd5f3fa89c9d343fc02712ea1a0d12083923015da49709db1c702010" exitCode=0
Jul 14 16:57:42.833066 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.832784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s" event={"ID":"c2d51719-5800-4d17-ac92-f979214f987e","Type":"ContainerDied","Data":"aa06fa0edd5f3fa89c9d343fc02712ea1a0d12083923015da49709db1c702010"}
Jul 14 16:57:42.834250 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.834230    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr" event={"ID":"bd37371d-ef4d-4825-867b-3ddf38376eb7","Type":"ContainerDied","Data":"ebea53bf2ee98ed63c1a2a7985a3f346fa2c69172929072ec86101fb60746cf9"}
Jul 14 16:57:42.834250 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.834245    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"
Jul 14 16:57:42.834406 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.834265    2562 scope.go:117] "RemoveContainer" containerID="db3e3d9d73d0109c67eac868409040cb53dd82a243cd7968e96337840f37a2c5"
Jul 14 16:57:42.855980 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.855959    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"]
Jul 14 16:57:42.859728 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.859700    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-528a5c/test-model-528a5c-kserve-5dd5b9ffcc-f84hr"]
Jul 14 16:57:42.887456 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:42.887407    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:57:43.010093 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010064    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-dshm\") pod \"c2d51719-5800-4d17-ac92-f979214f987e\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") "
Jul 14 16:57:43.010232 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010103    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-tmp-dir\") pod \"c2d51719-5800-4d17-ac92-f979214f987e\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") "
Jul 14 16:57:43.010232 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010130    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d51719-5800-4d17-ac92-f979214f987e-tls-certs\") pod \"c2d51719-5800-4d17-ac92-f979214f987e\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") "
Jul 14 16:57:43.010232 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-model-cache\") pod \"c2d51719-5800-4d17-ac92-f979214f987e\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") "
Jul 14 16:57:43.010232 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010172    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-home\") pod \"c2d51719-5800-4d17-ac92-f979214f987e\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") "
Jul 14 16:57:43.010232 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010188    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx47m\" (UniqueName: \"kubernetes.io/projected/c2d51719-5800-4d17-ac92-f979214f987e-kube-api-access-zx47m\") pod \"c2d51719-5800-4d17-ac92-f979214f987e\" (UID: \"c2d51719-5800-4d17-ac92-f979214f987e\") "
Jul 14 16:57:43.010497 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010374    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c2d51719-5800-4d17-ac92-f979214f987e" (UID: "c2d51719-5800-4d17-ac92-f979214f987e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:43.010497 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010425    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-model-cache" (OuterVolumeSpecName: "model-cache") pod "c2d51719-5800-4d17-ac92-f979214f987e" (UID: "c2d51719-5800-4d17-ac92-f979214f987e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:43.010497 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010436    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-home" (OuterVolumeSpecName: "home") pod "c2d51719-5800-4d17-ac92-f979214f987e" (UID: "c2d51719-5800-4d17-ac92-f979214f987e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:43.010608 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010509    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:43.010608 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010521    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:43.010608 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.010529    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:43.012466 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.012436    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-dshm" (OuterVolumeSpecName: "dshm") pod "c2d51719-5800-4d17-ac92-f979214f987e" (UID: "c2d51719-5800-4d17-ac92-f979214f987e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 16:57:43.012582 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.012478    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2d51719-5800-4d17-ac92-f979214f987e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c2d51719-5800-4d17-ac92-f979214f987e" (UID: "c2d51719-5800-4d17-ac92-f979214f987e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:57:43.012582 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.012518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2d51719-5800-4d17-ac92-f979214f987e-kube-api-access-zx47m" (OuterVolumeSpecName: "kube-api-access-zx47m") pod "c2d51719-5800-4d17-ac92-f979214f987e" (UID: "c2d51719-5800-4d17-ac92-f979214f987e"). InnerVolumeSpecName "kube-api-access-zx47m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:57:43.111547 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.111522    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx47m\" (UniqueName: \"kubernetes.io/projected/c2d51719-5800-4d17-ac92-f979214f987e-kube-api-access-zx47m\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:43.111547 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.111545    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c2d51719-5800-4d17-ac92-f979214f987e-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:43.111701 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.111555    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c2d51719-5800-4d17-ac92-f979214f987e-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:57:43.840494 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.840465    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"
Jul 14 16:57:43.840494 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.840486    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s" event={"ID":"c2d51719-5800-4d17-ac92-f979214f987e","Type":"ContainerDied","Data":"6476311920d8f069642b026dc62ba54eda2f2c310f4116b7072816604ac630cb"}
Jul 14 16:57:43.841057 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.840537    2562 scope.go:117] "RemoveContainer" containerID="aa06fa0edd5f3fa89c9d343fc02712ea1a0d12083923015da49709db1c702010"
Jul 14 16:57:43.849461 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.849436    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd37371d-ef4d-4825-867b-3ddf38376eb7" path="/var/lib/kubelet/pods/bd37371d-ef4d-4825-867b-3ddf38376eb7/volumes"
Jul 14 16:57:43.863207 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.863171    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"]
Jul 14 16:57:43.868866 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:43.868842    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-cff2fd/test-model-cff2fd-kserve-765d9559bc-l466s"]
Jul 14 16:57:45.848132 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:57:45.848094    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2d51719-5800-4d17-ac92-f979214f987e" path="/var/lib/kubelet/pods/c2d51719-5800-4d17-ac92-f979214f987e/volumes"
Jul 14 16:58:12.070747 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.070711    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"]
Jul 14 16:58:12.071232 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.070954    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q" podUID="0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" containerName="maas-api" containerID="cri-o://3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06" gracePeriod=30
Jul 14 16:58:12.311376 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.311353    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:58:12.359167 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.359145    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-openshift-service-ca\") pod \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") "
Jul 14 16:58:12.359307 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.359183    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-maas-api-tls\") pod \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") "
Jul 14 16:58:12.359307 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.359237    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2dh5\" (UniqueName: \"kubernetes.io/projected/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-kube-api-access-f2dh5\") pod \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\" (UID: \"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd\") "
Jul 14 16:58:12.359549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.359524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" (UID: "0751d4e5-44dc-4e6f-8251-e340b0b7ddfd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:58:12.361354 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.361332    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" (UID: "0751d4e5-44dc-4e6f-8251-e340b0b7ddfd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:58:12.361549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.361524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-kube-api-access-f2dh5" (OuterVolumeSpecName: "kube-api-access-f2dh5") pod "0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" (UID: "0751d4e5-44dc-4e6f-8251-e340b0b7ddfd"). InnerVolumeSpecName "kube-api-access-f2dh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:12.459872 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.459847    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2dh5\" (UniqueName: \"kubernetes.io/projected/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-kube-api-access-f2dh5\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:12.459872 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.459870    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-openshift-service-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:12.460020 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.459879    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd-maas-api-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:12.981871 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.981833    2562 generic.go:356] "Generic (PLEG): container finished" podID="0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" containerID="3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06" exitCode=0
Jul 14 16:58:12.982018 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.981877    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"
Jul 14 16:58:12.982018 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.981914    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q" event={"ID":"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd","Type":"ContainerDied","Data":"3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06"}
Jul 14 16:58:12.982018 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.981962    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q" event={"ID":"0751d4e5-44dc-4e6f-8251-e340b0b7ddfd","Type":"ContainerDied","Data":"445cc816ada5f9dc5641a1f624bf6ad9c6062e75f8d727d686d05135c40ec72f"}
Jul 14 16:58:12.982018 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.981984    2562 scope.go:117] "RemoveContainer" containerID="3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06"
Jul 14 16:58:12.991225 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.991208    2562 scope.go:117] "RemoveContainer" containerID="3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06"
Jul 14 16:58:12.991482 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:58:12.991459    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06\": container with ID starting with 3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06 not found: ID does not exist" containerID="3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06"
Jul 14 16:58:12.991580 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:12.991485    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06"} err="failed to get container status \"3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06\": rpc error: code = NotFound desc = could not find container \"3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06\": container with ID starting with 3fd8965ef3990acfbfd1961fb319520750ff3801cdce090e9a54e1a0f57a9d06 not found: ID does not exist"
Jul 14 16:58:13.003024 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:13.003005    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"]
Jul 14 16:58:13.009737 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:13.009710    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-cff2fd-6797784f7d-ts86q"]
Jul 14 16:58:13.848145 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:13.848112    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" path="/var/lib/kubelet/pods/0751d4e5-44dc-4e6f-8251-e340b0b7ddfd/volumes"
Jul 14 16:58:14.690796 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:14.690765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:58:22.192973 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.192931    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"]
Jul 14 16:58:22.193423 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193406    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd37371d-ef4d-4825-867b-3ddf38376eb7" containerName="main"
Jul 14 16:58:22.193423 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193424    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd37371d-ef4d-4825-867b-3ddf38376eb7" containerName="main"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193437    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2d51719-5800-4d17-ac92-f979214f987e" containerName="main"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193442    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2d51719-5800-4d17-ac92-f979214f987e" containerName="main"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193460    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" containerName="maas-api"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193466    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" containerName="maas-api"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0751d4e5-44dc-4e6f-8251-e340b0b7ddfd" containerName="maas-api"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193531    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2d51719-5800-4d17-ac92-f979214f987e" containerName="main"
Jul 14 16:58:22.193533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.193538    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd37371d-ef4d-4825-867b-3ddf38376eb7" containerName="main"
Jul 14 16:58:22.196611 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.196593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.205794 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.205774    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lsszz\""
Jul 14 16:58:22.205914 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.205842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-7f8436-serving-cert\""
Jul 14 16:58:22.214827 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.214806    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"]
Jul 14 16:58:22.346248 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.346199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.346457 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.346342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-maas-api-tls\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.346457 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.346384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbmpf\" (UniqueName: \"kubernetes.io/projected/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-kube-api-access-kbmpf\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.447951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.447857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-maas-api-tls\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.447951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.447903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbmpf\" (UniqueName: \"kubernetes.io/projected/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-kube-api-access-kbmpf\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.447951 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.447956    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.448561 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.448543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-openshift-service-ca\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.450476 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.450459    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-maas-api-tls\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.461987 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.461961    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbmpf\" (UniqueName: \"kubernetes.io/projected/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-kube-api-access-kbmpf\") pod \"maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") " pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.506469 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.506440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:22.650668 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:22.650617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"]
Jul 14 16:58:22.653675 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:58:22.653626    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83325cad_e2ca_45b0_8fa9_0d0805c7d04e.slice/crio-8db1c0adef91e7a6f24cd2d57bc6957daee15c27fbcd1c4124e37f8c01e20925 WatchSource:0}: Error finding container 8db1c0adef91e7a6f24cd2d57bc6957daee15c27fbcd1c4124e37f8c01e20925: Status 404 returned error can't find the container with id 8db1c0adef91e7a6f24cd2d57bc6957daee15c27fbcd1c4124e37f8c01e20925
Jul 14 16:58:23.031177 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:23.031145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" event={"ID":"83325cad-e2ca-45b0-8fa9-0d0805c7d04e","Type":"ContainerStarted","Data":"8db1c0adef91e7a6f24cd2d57bc6957daee15c27fbcd1c4124e37f8c01e20925"}
Jul 14 16:58:24.038408 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:24.038372    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" event={"ID":"83325cad-e2ca-45b0-8fa9-0d0805c7d04e","Type":"ContainerStarted","Data":"c4c88861e98a151113669ec465d8fce1ee2bf89b6796ab50c902e20fb53eae9f"}
Jul 14 16:58:24.038831 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:24.038467    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:24.072380 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:24.072336    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" podStartSLOduration=1.693140266 podStartE2EDuration="2.07232419s" totalImagesPullingTime="379.183924ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:58:24.070250751 +0000 UTC m=+1926.794879452" watchObservedRunningTime="2026-07-14 16:58:24.07232419 +0000 UTC m=+1926.796952891"
Jul 14 16:58:27.464398 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:27.464367    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:58:30.050086 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:30.050054    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:31.455926 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.455888    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"]
Jul 14 16:58:31.459398 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.459379    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.477190 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.477171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-0839f3-serving-cert\""
Jul 14 16:58:31.491744 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.491715    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"]
Jul 14 16:58:31.633828 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.633798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdsxs\" (UniqueName: \"kubernetes.io/projected/b4351f79-813c-4ab0-9d12-20cfad82e202-kube-api-access-qdsxs\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.633984 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.633843    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.633984 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.633955    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4351f79-813c-4ab0-9d12-20cfad82e202-openshift-service-ca\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.734474 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.734403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdsxs\" (UniqueName: \"kubernetes.io/projected/b4351f79-813c-4ab0-9d12-20cfad82e202-kube-api-access-qdsxs\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.734474 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.734451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.734626 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.734530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4351f79-813c-4ab0-9d12-20cfad82e202-openshift-service-ca\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.734626 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:58:31.734617    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-b-0839f3-serving-cert: secret "maas-api-e2e-api-b-0839f3-serving-cert" not found
Jul 14 16:58:31.734727 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:58:31.734701    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls podName:b4351f79-813c-4ab0-9d12-20cfad82e202 nodeName:}" failed. No retries permitted until 2026-07-14 16:58:32.234684259 +0000 UTC m=+1934.959312939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls") pod "maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" (UID: "b4351f79-813c-4ab0-9d12-20cfad82e202") : secret "maas-api-e2e-api-b-0839f3-serving-cert" not found
Jul 14 16:58:31.735137 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.735120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4351f79-813c-4ab0-9d12-20cfad82e202-openshift-service-ca\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:31.747657 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:31.747619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdsxs\" (UniqueName: \"kubernetes.io/projected/b4351f79-813c-4ab0-9d12-20cfad82e202-kube-api-access-qdsxs\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:32.238714 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:32.238678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:32.241373 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:32.241327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls\") pod \"maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") " pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:32.370540 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:32.370510    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:32.519864 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:32.519842    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"]
Jul 14 16:58:32.525024 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:58:32.524968    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4351f79_813c_4ab0_9d12_20cfad82e202.slice/crio-0be2d02f860b3f2165f1726e6c9d0ec4a66c73eafb5cbc9313b65fcf1ed56815 WatchSource:0}: Error finding container 0be2d02f860b3f2165f1726e6c9d0ec4a66c73eafb5cbc9313b65fcf1ed56815: Status 404 returned error can't find the container with id 0be2d02f860b3f2165f1726e6c9d0ec4a66c73eafb5cbc9313b65fcf1ed56815
Jul 14 16:58:33.083507 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:33.083419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" event={"ID":"b4351f79-813c-4ab0-9d12-20cfad82e202","Type":"ContainerStarted","Data":"3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f"}
Jul 14 16:58:33.083507 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:33.083477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" event={"ID":"b4351f79-813c-4ab0-9d12-20cfad82e202","Type":"ContainerStarted","Data":"0be2d02f860b3f2165f1726e6c9d0ec4a66c73eafb5cbc9313b65fcf1ed56815"}
Jul 14 16:58:33.083756 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:33.083574    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:33.110619 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:33.110545    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" podStartSLOduration=1.817546837 podStartE2EDuration="2.110526222s" totalImagesPullingTime="292.979385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:58:33.110342487 +0000 UTC m=+1935.834971190" watchObservedRunningTime="2026-07-14 16:58:33.110526222 +0000 UTC m=+1935.835154923"
Jul 14 16:58:36.792658 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:36.792588    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:58:39.093263 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:39.093232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:45.007229 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.007181    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"]
Jul 14 16:58:45.007687 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.007418    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" podUID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" containerName="maas-api" containerID="cri-o://c4c88861e98a151113669ec465d8fce1ee2bf89b6796ab50c902e20fb53eae9f" gracePeriod=30
Jul 14 16:58:45.043529 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.043499    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" podUID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.36:8443/health\": dial tcp 10.134.0.36:8443: connect: connection refused"
Jul 14 16:58:45.147723 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.147689    2562 generic.go:356] "Generic (PLEG): container finished" podID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" containerID="c4c88861e98a151113669ec465d8fce1ee2bf89b6796ab50c902e20fb53eae9f" exitCode=0
Jul 14 16:58:45.147850 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.147729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" event={"ID":"83325cad-e2ca-45b0-8fa9-0d0805c7d04e","Type":"ContainerDied","Data":"c4c88861e98a151113669ec465d8fce1ee2bf89b6796ab50c902e20fb53eae9f"}
Jul 14 16:58:45.257981 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.257916    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:45.344783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.344753    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbmpf\" (UniqueName: \"kubernetes.io/projected/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-kube-api-access-kbmpf\") pod \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") "
Jul 14 16:58:45.344783 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.344788    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-openshift-service-ca\") pod \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") "
Jul 14 16:58:45.344981 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.344841    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-maas-api-tls\") pod \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\" (UID: \"83325cad-e2ca-45b0-8fa9-0d0805c7d04e\") "
Jul 14 16:58:45.345142 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.345115    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83325cad-e2ca-45b0-8fa9-0d0805c7d04e" (UID: "83325cad-e2ca-45b0-8fa9-0d0805c7d04e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:58:45.346937 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.346908    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83325cad-e2ca-45b0-8fa9-0d0805c7d04e" (UID: "83325cad-e2ca-45b0-8fa9-0d0805c7d04e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:58:45.347048 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.346998    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-kube-api-access-kbmpf" (OuterVolumeSpecName: "kube-api-access-kbmpf") pod "83325cad-e2ca-45b0-8fa9-0d0805c7d04e" (UID: "83325cad-e2ca-45b0-8fa9-0d0805c7d04e"). InnerVolumeSpecName "kube-api-access-kbmpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:45.445565 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.445538    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbmpf\" (UniqueName: \"kubernetes.io/projected/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-kube-api-access-kbmpf\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:45.445565 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.445561    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-openshift-service-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:45.445758 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:45.445571    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83325cad-e2ca-45b0-8fa9-0d0805c7d04e-maas-api-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:46.153671 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:46.153603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"
Jul 14 16:58:46.154044 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:46.153600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2" event={"ID":"83325cad-e2ca-45b0-8fa9-0d0805c7d04e","Type":"ContainerDied","Data":"8db1c0adef91e7a6f24cd2d57bc6957daee15c27fbcd1c4124e37f8c01e20925"}
Jul 14 16:58:46.154044 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:46.153760    2562 scope.go:117] "RemoveContainer" containerID="c4c88861e98a151113669ec465d8fce1ee2bf89b6796ab50c902e20fb53eae9f"
Jul 14 16:58:46.171458 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:46.171422    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"]
Jul 14 16:58:46.173169 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:46.173149    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-7f8436-857d7c4677-pqzl2"]
Jul 14 16:58:47.848403 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:47.848363    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" path="/var/lib/kubelet/pods/83325cad-e2ca-45b0-8fa9-0d0805c7d04e/volumes"
Jul 14 16:58:49.006526 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:49.006489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:58:52.196048 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.196016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"]
Jul 14 16:58:52.196492 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.196250    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" podUID="b4351f79-813c-4ab0-9d12-20cfad82e202" containerName="maas-api" containerID="cri-o://3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f" gracePeriod=30
Jul 14 16:58:52.447937 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.447875    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:52.510356 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.510331    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls\") pod \"b4351f79-813c-4ab0-9d12-20cfad82e202\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") "
Jul 14 16:58:52.510538 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.510397    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdsxs\" (UniqueName: \"kubernetes.io/projected/b4351f79-813c-4ab0-9d12-20cfad82e202-kube-api-access-qdsxs\") pod \"b4351f79-813c-4ab0-9d12-20cfad82e202\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") "
Jul 14 16:58:52.510538 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.510440    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4351f79-813c-4ab0-9d12-20cfad82e202-openshift-service-ca\") pod \"b4351f79-813c-4ab0-9d12-20cfad82e202\" (UID: \"b4351f79-813c-4ab0-9d12-20cfad82e202\") "
Jul 14 16:58:52.510822 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.510795    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4351f79-813c-4ab0-9d12-20cfad82e202-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b4351f79-813c-4ab0-9d12-20cfad82e202" (UID: "b4351f79-813c-4ab0-9d12-20cfad82e202"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 16:58:52.512573 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.512550    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b4351f79-813c-4ab0-9d12-20cfad82e202" (UID: "b4351f79-813c-4ab0-9d12-20cfad82e202"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 16:58:52.512713 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.512593    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4351f79-813c-4ab0-9d12-20cfad82e202-kube-api-access-qdsxs" (OuterVolumeSpecName: "kube-api-access-qdsxs") pod "b4351f79-813c-4ab0-9d12-20cfad82e202" (UID: "b4351f79-813c-4ab0-9d12-20cfad82e202"). InnerVolumeSpecName "kube-api-access-qdsxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 16:58:52.611549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.611500    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b4351f79-813c-4ab0-9d12-20cfad82e202-maas-api-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:52.611549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.611544    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdsxs\" (UniqueName: \"kubernetes.io/projected/b4351f79-813c-4ab0-9d12-20cfad82e202-kube-api-access-qdsxs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:52.611549 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:52.611560    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4351f79-813c-4ab0-9d12-20cfad82e202-openshift-service-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 16:58:53.190918 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.190880    2562 generic.go:356] "Generic (PLEG): container finished" podID="b4351f79-813c-4ab0-9d12-20cfad82e202" containerID="3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f" exitCode=0
Jul 14 16:58:53.191124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.190944    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"
Jul 14 16:58:53.191124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.190968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" event={"ID":"b4351f79-813c-4ab0-9d12-20cfad82e202","Type":"ContainerDied","Data":"3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f"}
Jul 14 16:58:53.191124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.191048    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw" event={"ID":"b4351f79-813c-4ab0-9d12-20cfad82e202","Type":"ContainerDied","Data":"0be2d02f860b3f2165f1726e6c9d0ec4a66c73eafb5cbc9313b65fcf1ed56815"}
Jul 14 16:58:53.191124 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.191070    2562 scope.go:117] "RemoveContainer" containerID="3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f"
Jul 14 16:58:53.200244 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.200066    2562 scope.go:117] "RemoveContainer" containerID="3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f"
Jul 14 16:58:53.200488 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:58:53.200322    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f\": container with ID starting with 3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f not found: ID does not exist" containerID="3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f"
Jul 14 16:58:53.200488 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.200346    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f"} err="failed to get container status \"3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f\": rpc error: code = NotFound desc = could not find container \"3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f\": container with ID starting with 3450e7b5c7c16e78498a16da136eb2d236f1bf8bbb969207d5778241cb76f73f not found: ID does not exist"
Jul 14 16:58:53.213027 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.213002    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"]
Jul 14 16:58:53.216884 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.216863    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-0839f3-5b86bdddd9-m4bpw"]
Jul 14 16:58:53.848194 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:58:53.848157    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4351f79-813c-4ab0-9d12-20cfad82e202" path="/var/lib/kubelet/pods/b4351f79-813c-4ab0-9d12-20cfad82e202/volumes"
Jul 14 16:59:01.594151 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:01.594109    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:59:02.396226 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396196    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"]
Jul 14 16:59:02.396796 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396778    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4351f79-813c-4ab0-9d12-20cfad82e202" containerName="maas-api"
Jul 14 16:59:02.396883 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396799    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4351f79-813c-4ab0-9d12-20cfad82e202" containerName="maas-api"
Jul 14 16:59:02.396883 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396834    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" containerName="maas-api"
Jul 14 16:59:02.396883 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396843    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" containerName="maas-api"
Jul 14 16:59:02.396993 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396938    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="83325cad-e2ca-45b0-8fa9-0d0805c7d04e" containerName="maas-api"
Jul 14 16:59:02.396993 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.396948    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4351f79-813c-4ab0-9d12-20cfad82e202" containerName="maas-api"
Jul 14 16:59:02.401553 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.401532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.404565 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.404531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-lsszz\""
Jul 14 16:59:02.404698 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.404663    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-584665-serving-cert\""
Jul 14 16:59:02.417207 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.417186    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"]
Jul 14 16:59:02.498052 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.498019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.498184 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.498101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mdjp\" (UniqueName: \"kubernetes.io/projected/a022964a-e109-4277-b88b-7ce45fc0aad6-kube-api-access-7mdjp\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.498184 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.498138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a022964a-e109-4277-b88b-7ce45fc0aad6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.599610 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.599561    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.600115 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.599685    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mdjp\" (UniqueName: \"kubernetes.io/projected/a022964a-e109-4277-b88b-7ce45fc0aad6-kube-api-access-7mdjp\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.600115 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.599722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a022964a-e109-4277-b88b-7ce45fc0aad6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.600115 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:59:02.599739    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-584665-serving-cert: secret "maas-api-e2e-shared-a-584665-serving-cert" not found
Jul 14 16:59:02.600115 ip-10-0-142-177 kubenswrapper[2562]: E0714 16:59:02.599807    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls podName:a022964a-e109-4277-b88b-7ce45fc0aad6 nodeName:}" failed. No retries permitted until 2026-07-14 16:59:03.099791631 +0000 UTC m=+1965.824420309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls") pod "maas-api-e2e-shared-a-584665-76f6999878-dzt75" (UID: "a022964a-e109-4277-b88b-7ce45fc0aad6") : secret "maas-api-e2e-shared-a-584665-serving-cert" not found
Jul 14 16:59:02.600508 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.600486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a022964a-e109-4277-b88b-7ce45fc0aad6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:02.609423 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:02.609400    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mdjp\" (UniqueName: \"kubernetes.io/projected/a022964a-e109-4277-b88b-7ce45fc0aad6-kube-api-access-7mdjp\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:03.105225 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:03.105193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:03.107674 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:03.107628    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls\") pod \"maas-api-e2e-shared-a-584665-76f6999878-dzt75\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") " pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:03.311994 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:03.311964    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:03.442825 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:03.442562    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"]
Jul 14 16:59:03.444962 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:59:03.444937    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda022964a_e109_4277_b88b_7ce45fc0aad6.slice/crio-23696aba65a79e0fe07dc8ac70dd739cbb78eed9d51cb3c5a7b5d7944e375e65 WatchSource:0}: Error finding container 23696aba65a79e0fe07dc8ac70dd739cbb78eed9d51cb3c5a7b5d7944e375e65: Status 404 returned error can't find the container with id 23696aba65a79e0fe07dc8ac70dd739cbb78eed9d51cb3c5a7b5d7944e375e65
Jul 14 16:59:04.252048 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:04.252017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75" event={"ID":"a022964a-e109-4277-b88b-7ce45fc0aad6","Type":"ContainerStarted","Data":"a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781"}
Jul 14 16:59:04.252416 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:04.252076    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:04.252416 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:04.252099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75" event={"ID":"a022964a-e109-4277-b88b-7ce45fc0aad6","Type":"ContainerStarted","Data":"23696aba65a79e0fe07dc8ac70dd739cbb78eed9d51cb3c5a7b5d7944e375e65"}
Jul 14 16:59:04.270849 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:04.270797    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75" podStartSLOduration=1.9474740320000001 podStartE2EDuration="2.27078277s" totalImagesPullingTime="323.308738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:59:04.270423621 +0000 UTC m=+1966.995052322" watchObservedRunningTime="2026-07-14 16:59:04.27078277 +0000 UTC m=+1966.995411471"
Jul 14 16:59:10.261873 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:10.261803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 16:59:10.651322 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:10.651291    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:59:23.289467 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:23.289429    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:59:25.009959 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.009925    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"]
Jul 14 16:59:25.013144 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.013128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.016914 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.016890    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-584665\"/\"kube-root-ca.crt\""
Jul 14 16:59:25.017039 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.016894    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-584665\"/\"openshift-service-ca.crt\""
Jul 14 16:59:25.017977 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.017959    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-584665\"/\"default-dockercfg-vk9x9\""
Jul 14 16:59:25.019251 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.019234    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-584665\"/\"auth-test-model-584665-kserve-self-signed-certs\""
Jul 14 16:59:25.027403 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.027380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"]
Jul 14 16:59:25.098889 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.098854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tls-certs\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.098889 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.098900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tmp-dir\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.099128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.098946    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-model-cache\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.099128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.099010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5wvg\" (UniqueName: \"kubernetes.io/projected/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-kube-api-access-n5wvg\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.099128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.099036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-home\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.099128 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.099075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-dshm\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.199809 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.199775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-home\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200009 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.199850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-dshm\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200009 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.199910    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tls-certs\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200009 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.199950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tmp-dir\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200009 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.199998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-model-cache\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200217 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.200037    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5wvg\" (UniqueName: \"kubernetes.io/projected/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-kube-api-access-n5wvg\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200275 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.200234    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-home\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200338 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.200318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tmp-dir\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.200391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.200345    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-model-cache\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.202310 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.202284    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-dshm\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.202547 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.202529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tls-certs\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.209140 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.209121    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5wvg\" (UniqueName: \"kubernetes.io/projected/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-kube-api-access-n5wvg\") pod \"auth-test-model-584665-kserve-8678fbd99f-qvqrh\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") " pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.323328 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.323273    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:25.455120 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:25.455092    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"]
Jul 14 16:59:25.456704 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:59:25.456679    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f3c6c3d_90b1_4622_bde5_a31a2d5db87e.slice/crio-bf2b94f35b7483804e1da391dfd05ea41e0f52ba5255cdf2243e15907e7005a0 WatchSource:0}: Error finding container bf2b94f35b7483804e1da391dfd05ea41e0f52ba5255cdf2243e15907e7005a0: Status 404 returned error can't find the container with id bf2b94f35b7483804e1da391dfd05ea41e0f52ba5255cdf2243e15907e7005a0
Jul 14 16:59:26.358930 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:26.358896    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh" event={"ID":"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e","Type":"ContainerStarted","Data":"660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316"}
Jul 14 16:59:26.359284 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:26.358940    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh" event={"ID":"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e","Type":"ContainerStarted","Data":"bf2b94f35b7483804e1da391dfd05ea41e0f52ba5255cdf2243e15907e7005a0"}
Jul 14 16:59:26.376200 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:26.376149    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh" podStartSLOduration=2.376133882 podStartE2EDuration="2.376133882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:59:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:59:26.37501127 +0000 UTC m=+1989.099639975" watchObservedRunningTime="2026-07-14 16:59:26.376133882 +0000 UTC m=+1989.100762582"
Jul 14 16:59:35.323995 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:35.323949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:35.324409 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:35.324044    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:35.336682 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:35.336656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:35.413294 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:35.413271    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 16:59:35.797301 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:35.797270    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 16:59:58.315189 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.315159    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"]
Jul 14 16:59:58.318451 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.318430    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.321533 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.321513    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"openshift-service-ca.crt\""
Jul 14 16:59:58.322853 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.322836    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"default-dockercfg-928d6\""
Jul 14 16:59:58.322935 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.322839    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"kube-root-ca.crt\""
Jul 14 16:59:58.322935 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.322874    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"auth-test-model-314eb4-kserve-self-signed-certs\""
Jul 14 16:59:58.327807 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.327784    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"]
Jul 14 16:59:58.387991 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.387967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-model-cache\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.388090 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.387992    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866375ca-01d1-4ec1-97f2-58c3c79a063a-tls-certs\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.388090 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.388014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d55r\" (UniqueName: \"kubernetes.io/projected/866375ca-01d1-4ec1-97f2-58c3c79a063a-kube-api-access-7d55r\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.388090 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.388035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-dshm\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.388199 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.388095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-home\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.388199 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.388144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-tmp-dir\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-model-cache\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489391 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866375ca-01d1-4ec1-97f2-58c3c79a063a-tls-certs\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d55r\" (UniqueName: \"kubernetes.io/projected/866375ca-01d1-4ec1-97f2-58c3c79a063a-kube-api-access-7d55r\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-dshm\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-home\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489537 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-tmp-dir\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489810 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-model-cache\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.489939 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.489919    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-home\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.490032 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.490012    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-tmp-dir\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.491824 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.491805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-dshm\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.492095 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.492078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866375ca-01d1-4ec1-97f2-58c3c79a063a-tls-certs\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.498084 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.498060    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d55r\" (UniqueName: \"kubernetes.io/projected/866375ca-01d1-4ec1-97f2-58c3c79a063a-kube-api-access-7d55r\") pod \"auth-test-model-314eb4-kserve-858c7ffb7-cfdcw\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") " pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.628572 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.628551    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 16:59:58.765096 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:58.765067    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"]
Jul 14 16:59:58.767805 ip-10-0-142-177 kubenswrapper[2562]: W0714 16:59:58.767774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod866375ca_01d1_4ec1_97f2_58c3c79a063a.slice/crio-e1aa6261113d96f0aef0b94955b6b7a89426ff835f843623388ffaa2fde0f3e4 WatchSource:0}: Error finding container e1aa6261113d96f0aef0b94955b6b7a89426ff835f843623388ffaa2fde0f3e4: Status 404 returned error can't find the container with id e1aa6261113d96f0aef0b94955b6b7a89426ff835f843623388ffaa2fde0f3e4
Jul 14 16:59:59.517939 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:59.517908    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw" event={"ID":"866375ca-01d1-4ec1-97f2-58c3c79a063a","Type":"ContainerStarted","Data":"5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e"}
Jul 14 16:59:59.518325 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:59.517949    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw" event={"ID":"866375ca-01d1-4ec1-97f2-58c3c79a063a","Type":"ContainerStarted","Data":"e1aa6261113d96f0aef0b94955b6b7a89426ff835f843623388ffaa2fde0f3e4"}
Jul 14 16:59:59.556218 ip-10-0-142-177 kubenswrapper[2562]: I0714 16:59:59.556172    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw" podStartSLOduration=1.5561576609999999 podStartE2EDuration="1.556157661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 16:59:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 16:59:59.553699632 +0000 UTC m=+2022.278328334" watchObservedRunningTime="2026-07-14 16:59:59.556157661 +0000 UTC m=+2022.280786361"
Jul 14 17:00:00.143192 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.143160    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"]
Jul 14 17:00:00.146511 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.146495    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:00.157445 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.157419    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"]
Jul 14 17:00:00.307476 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.307447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfrg\" (UniqueName: \"kubernetes.io/projected/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0-kube-api-access-jtfrg\") pod \"maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m\" (UID: \"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:00.408116 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.408029    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfrg\" (UniqueName: \"kubernetes.io/projected/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0-kube-api-access-jtfrg\") pod \"maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m\" (UID: \"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:00.418327 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.418302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfrg\" (UniqueName: \"kubernetes.io/projected/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0-kube-api-access-jtfrg\") pod \"maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m\" (UID: \"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:00.459171 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.459148    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:00.604674 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:00.604645    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"]
Jul 14 17:00:00.606861 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:00:00.606835    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2ead3c_1a4f_4802_b175_2e8f9ddb12f0.slice/crio-8d904e4490b1d413d852b24f2e72ea7cd4e4b803bcad705b7696b686d6b9ce0b WatchSource:0}: Error finding container 8d904e4490b1d413d852b24f2e72ea7cd4e4b803bcad705b7696b686d6b9ce0b: Status 404 returned error can't find the container with id 8d904e4490b1d413d852b24f2e72ea7cd4e4b803bcad705b7696b686d6b9ce0b
Jul 14 17:00:01.532268 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:01.532232    2562 generic.go:356] "Generic (PLEG): container finished" podID="be2ead3c-1a4f-4802-b175-2e8f9ddb12f0" containerID="e9b621e8972865f78b8660b05109539fbe59a4edf3377a5ddc09383118e51a91" exitCode=0
Jul 14 17:00:01.532406 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:01.532280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m" event={"ID":"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0","Type":"ContainerDied","Data":"e9b621e8972865f78b8660b05109539fbe59a4edf3377a5ddc09383118e51a91"}
Jul 14 17:00:01.532406 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:01.532329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m" event={"ID":"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0","Type":"ContainerStarted","Data":"8d904e4490b1d413d852b24f2e72ea7cd4e4b803bcad705b7696b686d6b9ce0b"}
Jul 14 17:00:01.694683 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:01.694644    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:00:02.668995 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:02.668972    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:02.831889 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:02.831820    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtfrg\" (UniqueName: \"kubernetes.io/projected/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0-kube-api-access-jtfrg\") pod \"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0\" (UID: \"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0\") "
Jul 14 17:00:02.833952 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:02.833931    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0-kube-api-access-jtfrg" (OuterVolumeSpecName: "kube-api-access-jtfrg") pod "be2ead3c-1a4f-4802-b175-2e8f9ddb12f0" (UID: "be2ead3c-1a4f-4802-b175-2e8f9ddb12f0"). InnerVolumeSpecName "kube-api-access-jtfrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:00:02.933245 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:02.933216    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtfrg\" (UniqueName: \"kubernetes.io/projected/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0-kube-api-access-jtfrg\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:00:03.543265 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:03.543237    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"
Jul 14 17:00:03.543438 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:03.543237    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m" event={"ID":"be2ead3c-1a4f-4802-b175-2e8f9ddb12f0","Type":"ContainerDied","Data":"8d904e4490b1d413d852b24f2e72ea7cd4e4b803bcad705b7696b686d6b9ce0b"}
Jul 14 17:00:03.543438 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:03.543355    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d904e4490b1d413d852b24f2e72ea7cd4e4b803bcad705b7696b686d6b9ce0b"
Jul 14 17:00:08.629471 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:08.629433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 17:00:08.629999 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:08.629493    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 17:00:08.642057 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:08.642033    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 17:00:09.585597 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:09.585561    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 17:00:16.691080 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:16.691045    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:00:33.387439 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:33.387397    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:00:47.391530 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:00:47.391456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:01:03.395385 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:03.395350    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:01:18.299138 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:18.299035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 17:01:18.301407 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:18.301385    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4rfpt_42b8745d-23b6-42a8-941f-4dee7eb3414b/ovn-acl-logging/0.log"
Jul 14 17:01:20.090628 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:20.090592    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:01:34.892617 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:34.892581    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:01:50.986845 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:50.986815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:01:54.408790 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:54.408763    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"]
Jul 14 17:01:55.250508 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:01:55.250463    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"]
Jul 14 17:02:03.513152 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.513114    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"]
Jul 14 17:02:03.513697 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.513679    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2ead3c-1a4f-4802-b175-2e8f9ddb12f0" containerName="cleanup"
Jul 14 17:02:03.513793 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.513699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2ead3c-1a4f-4802-b175-2e8f9ddb12f0" containerName="cleanup"
Jul 14 17:02:03.513852 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.513808    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2ead3c-1a4f-4802-b175-2e8f9ddb12f0" containerName="cleanup"
Jul 14 17:02:03.517526 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.517505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.520520 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.520499    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-584665\"/\"sub-test-model-584665-kserve-self-signed-certs\""
Jul 14 17:02:03.528916 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.528894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"]
Jul 14 17:02:03.590796 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.590777    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-dshm\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.590895 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.590828    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r9qv\" (UniqueName: \"kubernetes.io/projected/6769d916-8c86-4e2a-a09a-93e75f854c2c-kube-api-access-6r9qv\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.590895 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.590864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-home\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.590972 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.590928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-model-cache\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.590972 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.590949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-tmp-dir\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.590972 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.590971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6769d916-8c86-4e2a-a09a-93e75f854c2c-tls-certs\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692326 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-home\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692442 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-model-cache\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692442 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-tmp-dir\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692442 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692414    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6769d916-8c86-4e2a-a09a-93e75f854c2c-tls-certs\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692609 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-dshm\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692609 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692548    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r9qv\" (UniqueName: \"kubernetes.io/projected/6769d916-8c86-4e2a-a09a-93e75f854c2c-kube-api-access-6r9qv\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692739 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-home\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692794 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692766    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-model-cache\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.692794 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.692773    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-tmp-dir\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.694846 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.694824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-dshm\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.695126 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.695108    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6769d916-8c86-4e2a-a09a-93e75f854c2c-tls-certs\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.701596 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.701574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r9qv\" (UniqueName: \"kubernetes.io/projected/6769d916-8c86-4e2a-a09a-93e75f854c2c-kube-api-access-6r9qv\") pod \"sub-test-model-584665-kserve-7966bf44b7-csl2k\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") " pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.827941 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.827882    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:03.961767 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:03.961741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"]
Jul 14 17:02:03.963697 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:02:03.963667    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6769d916_8c86_4e2a_a09a_93e75f854c2c.slice/crio-836602dd4074412c66bf967967a7cd649e3cbc175e3ec602e3b8b882c43dc480 WatchSource:0}: Error finding container 836602dd4074412c66bf967967a7cd649e3cbc175e3ec602e3b8b882c43dc480: Status 404 returned error can't find the container with id 836602dd4074412c66bf967967a7cd649e3cbc175e3ec602e3b8b882c43dc480
Jul 14 17:02:04.157332 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:04.157296    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k" event={"ID":"6769d916-8c86-4e2a-a09a-93e75f854c2c","Type":"ContainerStarted","Data":"13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df"}
Jul 14 17:02:04.157475 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:04.157342    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k" event={"ID":"6769d916-8c86-4e2a-a09a-93e75f854c2c","Type":"ContainerStarted","Data":"836602dd4074412c66bf967967a7cd649e3cbc175e3ec602e3b8b882c43dc480"}
Jul 14 17:02:04.175891 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:04.175832    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k" podStartSLOduration=1.17581747 podStartE2EDuration="1.17581747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:02:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:02:04.174178499 +0000 UTC m=+2146.898807201" watchObservedRunningTime="2026-07-14 17:02:04.17581747 +0000 UTC m=+2146.900446218"
Jul 14 17:02:06.490339 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:06.490312    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:02:09.429151 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.429061    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh" podUID="6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" containerName="main" containerID="cri-o://660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316" gracePeriod=45
Jul 14 17:02:09.681522 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.681464    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 17:02:09.749163 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749136    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-home\") pod \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") "
Jul 14 17:02:09.749315 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749177    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-model-cache\") pod \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") "
Jul 14 17:02:09.749315 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749215    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-dshm\") pod \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") "
Jul 14 17:02:09.749315 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749255    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5wvg\" (UniqueName: \"kubernetes.io/projected/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-kube-api-access-n5wvg\") pod \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") "
Jul 14 17:02:09.749485 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749318    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tls-certs\") pod \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") "
Jul 14 17:02:09.749485 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tmp-dir\") pod \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\" (UID: \"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e\") "
Jul 14 17:02:09.749485 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749405    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-model-cache" (OuterVolumeSpecName: "model-cache") pod "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" (UID: "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:09.749485 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749427    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-home" (OuterVolumeSpecName: "home") pod "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" (UID: "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:09.749736 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749694    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:09.749736 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749705    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" (UID: "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:09.749736 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.749712    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:09.751578 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.751555    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-dshm" (OuterVolumeSpecName: "dshm") pod "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" (UID: "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:09.751578 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.751570    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-kube-api-access-n5wvg" (OuterVolumeSpecName: "kube-api-access-n5wvg") pod "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" (UID: "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e"). InnerVolumeSpecName "kube-api-access-n5wvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:02:09.751819 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.751802    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" (UID: "6f3c6c3d-90b1-4622-bde5-a31a2d5db87e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:02:09.850419 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.850395    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:09.850419 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.850415    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5wvg\" (UniqueName: \"kubernetes.io/projected/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-kube-api-access-n5wvg\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:09.850581 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.850425    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:09.850581 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:09.850456    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:10.186481 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.186446    2562 generic.go:356] "Generic (PLEG): container finished" podID="6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" containerID="660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316" exitCode=0
Jul 14 17:02:10.186667 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.186484    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"
Jul 14 17:02:10.186667 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.186535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh" event={"ID":"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e","Type":"ContainerDied","Data":"660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316"}
Jul 14 17:02:10.186667 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.186575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh" event={"ID":"6f3c6c3d-90b1-4622-bde5-a31a2d5db87e","Type":"ContainerDied","Data":"bf2b94f35b7483804e1da391dfd05ea41e0f52ba5255cdf2243e15907e7005a0"}
Jul 14 17:02:10.186667 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.186592    2562 scope.go:117] "RemoveContainer" containerID="660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316"
Jul 14 17:02:10.195736 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.195718    2562 scope.go:117] "RemoveContainer" containerID="660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316"
Jul 14 17:02:10.195996 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:02:10.195980    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316\": container with ID starting with 660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316 not found: ID does not exist" containerID="660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316"
Jul 14 17:02:10.196047 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.196004    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316"} err="failed to get container status \"660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316\": rpc error: code = NotFound desc = could not find container \"660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316\": container with ID starting with 660b0eac4c59f3c86de523f4d91b38da6462445269d0be6622c53609c7ccc316 not found: ID does not exist"
Jul 14 17:02:10.203828 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.203805    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"]
Jul 14 17:02:10.207736 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.207717    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-584665/auth-test-model-584665-kserve-8678fbd99f-qvqrh"]
Jul 14 17:02:10.271006 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.270973    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw" podUID="866375ca-01d1-4ec1-97f2-58c3c79a063a" containerName="main" containerID="cri-o://5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e" gracePeriod=45
Jul 14 17:02:10.514243 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.514217    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 17:02:10.658613 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-model-cache\") pod \"866375ca-01d1-4ec1-97f2-58c3c79a063a\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") "
Jul 14 17:02:10.658804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658669    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866375ca-01d1-4ec1-97f2-58c3c79a063a-tls-certs\") pod \"866375ca-01d1-4ec1-97f2-58c3c79a063a\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") "
Jul 14 17:02:10.658804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658705    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-tmp-dir\") pod \"866375ca-01d1-4ec1-97f2-58c3c79a063a\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") "
Jul 14 17:02:10.658804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658740    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7d55r\" (UniqueName: \"kubernetes.io/projected/866375ca-01d1-4ec1-97f2-58c3c79a063a-kube-api-access-7d55r\") pod \"866375ca-01d1-4ec1-97f2-58c3c79a063a\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") "
Jul 14 17:02:10.658804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658769    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-dshm\") pod \"866375ca-01d1-4ec1-97f2-58c3c79a063a\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") "
Jul 14 17:02:10.658804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658794    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-home\") pod \"866375ca-01d1-4ec1-97f2-58c3c79a063a\" (UID: \"866375ca-01d1-4ec1-97f2-58c3c79a063a\") "
Jul 14 17:02:10.659147 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658896    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-model-cache" (OuterVolumeSpecName: "model-cache") pod "866375ca-01d1-4ec1-97f2-58c3c79a063a" (UID: "866375ca-01d1-4ec1-97f2-58c3c79a063a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:10.659147 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.658954    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "866375ca-01d1-4ec1-97f2-58c3c79a063a" (UID: "866375ca-01d1-4ec1-97f2-58c3c79a063a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:10.659147 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.659113    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:10.659147 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.659146    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:10.659303 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.659109    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-home" (OuterVolumeSpecName: "home") pod "866375ca-01d1-4ec1-97f2-58c3c79a063a" (UID: "866375ca-01d1-4ec1-97f2-58c3c79a063a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:10.661091 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.661064    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-dshm" (OuterVolumeSpecName: "dshm") pod "866375ca-01d1-4ec1-97f2-58c3c79a063a" (UID: "866375ca-01d1-4ec1-97f2-58c3c79a063a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:02:10.661185 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.661154    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/866375ca-01d1-4ec1-97f2-58c3c79a063a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "866375ca-01d1-4ec1-97f2-58c3c79a063a" (UID: "866375ca-01d1-4ec1-97f2-58c3c79a063a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:02:10.661185 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.661150    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/866375ca-01d1-4ec1-97f2-58c3c79a063a-kube-api-access-7d55r" (OuterVolumeSpecName: "kube-api-access-7d55r") pod "866375ca-01d1-4ec1-97f2-58c3c79a063a" (UID: "866375ca-01d1-4ec1-97f2-58c3c79a063a"). InnerVolumeSpecName "kube-api-access-7d55r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:02:10.759973 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.759886    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7d55r\" (UniqueName: \"kubernetes.io/projected/866375ca-01d1-4ec1-97f2-58c3c79a063a-kube-api-access-7d55r\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:10.759973 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.759916    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:10.759973 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.759931    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/866375ca-01d1-4ec1-97f2-58c3c79a063a-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:10.759973 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:10.759941    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/866375ca-01d1-4ec1-97f2-58c3c79a063a-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:02:11.193292 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.193256    2562 generic.go:356] "Generic (PLEG): container finished" podID="866375ca-01d1-4ec1-97f2-58c3c79a063a" containerID="5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e" exitCode=0
Jul 14 17:02:11.193462 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.193304    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"
Jul 14 17:02:11.193462 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.193341    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw" event={"ID":"866375ca-01d1-4ec1-97f2-58c3c79a063a","Type":"ContainerDied","Data":"5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e"}
Jul 14 17:02:11.193462 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.193385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw" event={"ID":"866375ca-01d1-4ec1-97f2-58c3c79a063a","Type":"ContainerDied","Data":"e1aa6261113d96f0aef0b94955b6b7a89426ff835f843623388ffaa2fde0f3e4"}
Jul 14 17:02:11.193462 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.193404    2562 scope.go:117] "RemoveContainer" containerID="5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e"
Jul 14 17:02:11.202538 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.202520    2562 scope.go:117] "RemoveContainer" containerID="5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e"
Jul 14 17:02:11.202809 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:02:11.202793    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e\": container with ID starting with 5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e not found: ID does not exist" containerID="5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e"
Jul 14 17:02:11.202890 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.202822    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e"} err="failed to get container status \"5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e\": rpc error: code = NotFound desc = could not find container \"5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e\": container with ID starting with 5fa0e768d264c54fc3bd7cc754b77c0c741f2bed41855b05a1f312309fade20e not found: ID does not exist"
Jul 14 17:02:11.216038 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.216016    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"]
Jul 14 17:02:11.222829 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.222809    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/auth-test-model-314eb4-kserve-858c7ffb7-cfdcw"]
Jul 14 17:02:11.847759 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.847730    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" path="/var/lib/kubelet/pods/6f3c6c3d-90b1-4622-bde5-a31a2d5db87e/volumes"
Jul 14 17:02:11.848162 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:11.848106    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="866375ca-01d1-4ec1-97f2-58c3c79a063a" path="/var/lib/kubelet/pods/866375ca-01d1-4ec1-97f2-58c3c79a063a/volumes"
Jul 14 17:02:13.828975 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:13.828942    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:13.829393 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:13.829221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:13.841306 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:13.841282    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:14.221170 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:14.221132    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:02:26.604784 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.604752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"]
Jul 14 17:02:26.605265 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.605249    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" containerName="main"
Jul 14 17:02:26.605310 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.605267    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" containerName="main"
Jul 14 17:02:26.605310 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.605278    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="866375ca-01d1-4ec1-97f2-58c3c79a063a" containerName="main"
Jul 14 17:02:26.605310 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.605283    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="866375ca-01d1-4ec1-97f2-58c3c79a063a" containerName="main"
Jul 14 17:02:26.605405 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.605384    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="866375ca-01d1-4ec1-97f2-58c3c79a063a" containerName="main"
Jul 14 17:02:26.605405 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.605392    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f3c6c3d-90b1-4622-bde5-a31a2d5db87e" containerName="main"
Jul 14 17:02:26.608486 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.608469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.611370 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.611346    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"kube-root-ca.crt\""
Jul 14 17:02:26.612798 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.612773    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"default-dockercfg-928d6\""
Jul 14 17:02:26.612928 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.612853    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"openshift-service-ca.crt\""
Jul 14 17:02:26.612928 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.612880    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"sub-test-model-314eb4-kserve-self-signed-certs\""
Jul 14 17:02:26.621754 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.621732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"]
Jul 14 17:02:26.710890 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.710857    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgkbj\" (UniqueName: \"kubernetes.io/projected/e35ee428-f36c-44c1-b87a-cd3f29131b4d-kube-api-access-pgkbj\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.710890 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.710898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-dshm\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.711131 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.710917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-model-cache\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.711131 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.711063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tmp-dir\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.711131 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.711112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tls-certs\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.711252 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.711132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-home\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.811666 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.811603    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgkbj\" (UniqueName: \"kubernetes.io/projected/e35ee428-f36c-44c1-b87a-cd3f29131b4d-kube-api-access-pgkbj\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.811843 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.811678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-dshm\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.811843 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.811709    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-model-cache\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.811843 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.811831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tmp-dir\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.811992 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.811869    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tls-certs\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.811992 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.811893    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-home\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.812149 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.812130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-model-cache\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.812208 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.812188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tmp-dir\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.812261 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.812228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-home\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.814156 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.814132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-dshm\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.814353 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.814338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tls-certs\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.821135 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.821113    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgkbj\" (UniqueName: \"kubernetes.io/projected/e35ee428-f36c-44c1-b87a-cd3f29131b4d-kube-api-access-pgkbj\") pod \"sub-test-model-314eb4-kserve-7b8fc77d9-msfnq\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") " pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:26.919626 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:26.919597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:27.054475 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:27.054443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"]
Jul 14 17:02:27.058280 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:02:27.058248    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode35ee428_f36c_44c1_b87a_cd3f29131b4d.slice/crio-3498306bd5c2c37d2e595b7abc7d3089d8419c91ee6fefcb34ef2a8307b22322 WatchSource:0}: Error finding container 3498306bd5c2c37d2e595b7abc7d3089d8419c91ee6fefcb34ef2a8307b22322: Status 404 returned error can't find the container with id 3498306bd5c2c37d2e595b7abc7d3089d8419c91ee6fefcb34ef2a8307b22322
Jul 14 17:02:27.280944 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:27.280856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq" event={"ID":"e35ee428-f36c-44c1-b87a-cd3f29131b4d","Type":"ContainerStarted","Data":"468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2"}
Jul 14 17:02:27.280944 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:27.280904    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq" event={"ID":"e35ee428-f36c-44c1-b87a-cd3f29131b4d","Type":"ContainerStarted","Data":"3498306bd5c2c37d2e595b7abc7d3089d8419c91ee6fefcb34ef2a8307b22322"}
Jul 14 17:02:27.299804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:27.299758    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq" podStartSLOduration=1.299743433 podStartE2EDuration="1.299743433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:02:27.298920861 +0000 UTC m=+2170.023549563" watchObservedRunningTime="2026-07-14 17:02:27.299743433 +0000 UTC m=+2170.024372134"
Jul 14 17:02:30.586577 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:30.586543    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:02:36.920345 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:36.920312    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:36.920756 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:36.920365    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:36.932568 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:36.932549    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:37.339408 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:37.339325    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:02:49.786556 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:02:49.786516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:03:04.174870 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:04.174833    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"]
Jul 14 17:03:04.984386 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:04.984346    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"]
Jul 14 17:03:08.285976 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:08.285938    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:03:13.017735 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.017704    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"]
Jul 14 17:03:13.021415 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.021398    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.024462 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.024442    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-584665\"/\"rate-test-model-584665-kserve-self-signed-certs\""
Jul 14 17:03:13.026442 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.026412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-dshm\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.026562 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.026542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-home\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.026715 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.026693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tls-certs\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.026846 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.026743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tmp-dir\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.026846 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.026821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf4h4\" (UniqueName: \"kubernetes.io/projected/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-kube-api-access-xf4h4\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.026970 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.026855    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-model-cache\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.032424 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.032393    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"]
Jul 14 17:03:13.127586 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.127557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-dshm\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.127775 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.127595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-home\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.127775 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.127655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tls-certs\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.127775 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.127688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tmp-dir\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.127775 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.127727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf4h4\" (UniqueName: \"kubernetes.io/projected/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-kube-api-access-xf4h4\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.127775 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.127755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-model-cache\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.128109 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.128088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-home\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.128180 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.128111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tmp-dir\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.128180 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.128157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-model-cache\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.129964 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.129942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-dshm\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.130217 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.130199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tls-certs\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.135990 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.135964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf4h4\" (UniqueName: \"kubernetes.io/projected/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-kube-api-access-xf4h4\") pod \"rate-test-model-584665-kserve-77fc6b7755-sn8fd\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") " pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.332719 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.332614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:13.479519 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.479493    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"]
Jul 14 17:03:13.481179 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:03:13.481136    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab0856b2_cc96_425e_aaf6_b8bf95f33bf9.slice/crio-9c530b654ccd414b77aea653d146b3dff6fd5c534e6e9a0e9dade139991b052e WatchSource:0}: Error finding container 9c530b654ccd414b77aea653d146b3dff6fd5c534e6e9a0e9dade139991b052e: Status 404 returned error can't find the container with id 9c530b654ccd414b77aea653d146b3dff6fd5c534e6e9a0e9dade139991b052e
Jul 14 17:03:13.510283 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:13.510258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd" event={"ID":"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9","Type":"ContainerStarted","Data":"9c530b654ccd414b77aea653d146b3dff6fd5c534e6e9a0e9dade139991b052e"}
Jul 14 17:03:14.517459 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:14.517421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd" event={"ID":"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9","Type":"ContainerStarted","Data":"d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3"}
Jul 14 17:03:14.535842 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:14.535796    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd" podStartSLOduration=2.535780517 podStartE2EDuration="2.535780517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:03:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:03:14.535310265 +0000 UTC m=+2217.259938968" watchObservedRunningTime="2026-07-14 17:03:14.535780517 +0000 UTC m=+2217.260409218"
Jul 14 17:03:19.194808 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.194765    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k" podUID="6769d916-8c86-4e2a-a09a-93e75f854c2c" containerName="main" containerID="cri-o://13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df" gracePeriod=45
Jul 14 17:03:19.443707 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.443680    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:03:19.482579 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482510    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-home\") pod \"6769d916-8c86-4e2a-a09a-93e75f854c2c\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") "
Jul 14 17:03:19.482579 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6r9qv\" (UniqueName: \"kubernetes.io/projected/6769d916-8c86-4e2a-a09a-93e75f854c2c-kube-api-access-6r9qv\") pod \"6769d916-8c86-4e2a-a09a-93e75f854c2c\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") "
Jul 14 17:03:19.482813 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482584    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-tmp-dir\") pod \"6769d916-8c86-4e2a-a09a-93e75f854c2c\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") "
Jul 14 17:03:19.482813 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-dshm\") pod \"6769d916-8c86-4e2a-a09a-93e75f854c2c\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") "
Jul 14 17:03:19.482813 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-model-cache\") pod \"6769d916-8c86-4e2a-a09a-93e75f854c2c\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") "
Jul 14 17:03:19.482813 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482709    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6769d916-8c86-4e2a-a09a-93e75f854c2c-tls-certs\") pod \"6769d916-8c86-4e2a-a09a-93e75f854c2c\" (UID: \"6769d916-8c86-4e2a-a09a-93e75f854c2c\") "
Jul 14 17:03:19.483031 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482825    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-home" (OuterVolumeSpecName: "home") pod "6769d916-8c86-4e2a-a09a-93e75f854c2c" (UID: "6769d916-8c86-4e2a-a09a-93e75f854c2c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:19.483031 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482863    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6769d916-8c86-4e2a-a09a-93e75f854c2c" (UID: "6769d916-8c86-4e2a-a09a-93e75f854c2c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:19.483031 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.482959    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-model-cache" (OuterVolumeSpecName: "model-cache") pod "6769d916-8c86-4e2a-a09a-93e75f854c2c" (UID: "6769d916-8c86-4e2a-a09a-93e75f854c2c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:19.483198 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.483149    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:19.483198 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.483165    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:19.483198 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.483174    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:19.484898 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.484872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6769d916-8c86-4e2a-a09a-93e75f854c2c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6769d916-8c86-4e2a-a09a-93e75f854c2c" (UID: "6769d916-8c86-4e2a-a09a-93e75f854c2c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:03:19.484898 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.484872    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6769d916-8c86-4e2a-a09a-93e75f854c2c-kube-api-access-6r9qv" (OuterVolumeSpecName: "kube-api-access-6r9qv") pod "6769d916-8c86-4e2a-a09a-93e75f854c2c" (UID: "6769d916-8c86-4e2a-a09a-93e75f854c2c"). InnerVolumeSpecName "kube-api-access-6r9qv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:03:19.485028 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.484874    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-dshm" (OuterVolumeSpecName: "dshm") pod "6769d916-8c86-4e2a-a09a-93e75f854c2c" (UID: "6769d916-8c86-4e2a-a09a-93e75f854c2c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:19.542756 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.542727    2562 generic.go:356] "Generic (PLEG): container finished" podID="6769d916-8c86-4e2a-a09a-93e75f854c2c" containerID="13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df" exitCode=0
Jul 14 17:03:19.542868 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.542762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k" event={"ID":"6769d916-8c86-4e2a-a09a-93e75f854c2c","Type":"ContainerDied","Data":"13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df"}
Jul 14 17:03:19.542868 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.542769    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"
Jul 14 17:03:19.542868 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.542789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k" event={"ID":"6769d916-8c86-4e2a-a09a-93e75f854c2c","Type":"ContainerDied","Data":"836602dd4074412c66bf967967a7cd649e3cbc175e3ec602e3b8b882c43dc480"}
Jul 14 17:03:19.542868 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.542805    2562 scope.go:117] "RemoveContainer" containerID="13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df"
Jul 14 17:03:19.552019 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.552001    2562 scope.go:117] "RemoveContainer" containerID="13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df"
Jul 14 17:03:19.552257 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:03:19.552239    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df\": container with ID starting with 13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df not found: ID does not exist" containerID="13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df"
Jul 14 17:03:19.552315 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.552266    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df"} err="failed to get container status \"13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df\": rpc error: code = NotFound desc = could not find container \"13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df\": container with ID starting with 13b813b5076aa5fef1a483fe388737397385711f83e30fbd59fd74eed04b80df not found: ID does not exist"
Jul 14 17:03:19.564128 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.564107    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"]
Jul 14 17:03:19.570901 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.570882    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-584665/sub-test-model-584665-kserve-7966bf44b7-csl2k"]
Jul 14 17:03:19.584406 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.584383    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6769d916-8c86-4e2a-a09a-93e75f854c2c-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:19.584406 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.584405    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6r9qv\" (UniqueName: \"kubernetes.io/projected/6769d916-8c86-4e2a-a09a-93e75f854c2c-kube-api-access-6r9qv\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:19.584533 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.584414    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6769d916-8c86-4e2a-a09a-93e75f854c2c-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:19.847367 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:19.847283    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6769d916-8c86-4e2a-a09a-93e75f854c2c" path="/var/lib/kubelet/pods/6769d916-8c86-4e2a-a09a-93e75f854c2c/volumes"
Jul 14 17:03:20.005067 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.005013    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq" podUID="e35ee428-f36c-44c1-b87a-cd3f29131b4d" containerName="main" containerID="cri-o://468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2" gracePeriod=45
Jul 14 17:03:20.271647 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.271603    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:03:20.392521 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392437    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgkbj\" (UniqueName: \"kubernetes.io/projected/e35ee428-f36c-44c1-b87a-cd3f29131b4d-kube-api-access-pgkbj\") pod \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") "
Jul 14 17:03:20.392521 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-model-cache\") pod \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") "
Jul 14 17:03:20.392744 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392533    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-home\") pod \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") "
Jul 14 17:03:20.392744 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392553    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tls-certs\") pod \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") "
Jul 14 17:03:20.392744 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392597    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-dshm\") pod \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") "
Jul 14 17:03:20.392744 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tmp-dir\") pod \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\" (UID: \"e35ee428-f36c-44c1-b87a-cd3f29131b4d\") "
Jul 14 17:03:20.392954 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392785    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-model-cache" (OuterVolumeSpecName: "model-cache") pod "e35ee428-f36c-44c1-b87a-cd3f29131b4d" (UID: "e35ee428-f36c-44c1-b87a-cd3f29131b4d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:20.392954 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.392874    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-home" (OuterVolumeSpecName: "home") pod "e35ee428-f36c-44c1-b87a-cd3f29131b4d" (UID: "e35ee428-f36c-44c1-b87a-cd3f29131b4d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:20.393067 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.393006    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e35ee428-f36c-44c1-b87a-cd3f29131b4d" (UID: "e35ee428-f36c-44c1-b87a-cd3f29131b4d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:20.393113 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.393074    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:20.393113 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.393098    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:20.394757 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.394731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e35ee428-f36c-44c1-b87a-cd3f29131b4d-kube-api-access-pgkbj" (OuterVolumeSpecName: "kube-api-access-pgkbj") pod "e35ee428-f36c-44c1-b87a-cd3f29131b4d" (UID: "e35ee428-f36c-44c1-b87a-cd3f29131b4d"). InnerVolumeSpecName "kube-api-access-pgkbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:03:20.394864 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.394798    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-dshm" (OuterVolumeSpecName: "dshm") pod "e35ee428-f36c-44c1-b87a-cd3f29131b4d" (UID: "e35ee428-f36c-44c1-b87a-cd3f29131b4d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:03:20.394864 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.394832    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e35ee428-f36c-44c1-b87a-cd3f29131b4d" (UID: "e35ee428-f36c-44c1-b87a-cd3f29131b4d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:03:20.493895 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.493867    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgkbj\" (UniqueName: \"kubernetes.io/projected/e35ee428-f36c-44c1-b87a-cd3f29131b4d-kube-api-access-pgkbj\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:20.493895 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.493891    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:20.493895 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.493900    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:20.494081 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.493907    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35ee428-f36c-44c1-b87a-cd3f29131b4d-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:03:20.548795 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.548762    2562 generic.go:356] "Generic (PLEG): container finished" podID="e35ee428-f36c-44c1-b87a-cd3f29131b4d" containerID="468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2" exitCode=0
Jul 14 17:03:20.548957 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.548806    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"
Jul 14 17:03:20.548957 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.548846    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq" event={"ID":"e35ee428-f36c-44c1-b87a-cd3f29131b4d","Type":"ContainerDied","Data":"468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2"}
Jul 14 17:03:20.548957 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.548888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq" event={"ID":"e35ee428-f36c-44c1-b87a-cd3f29131b4d","Type":"ContainerDied","Data":"3498306bd5c2c37d2e595b7abc7d3089d8419c91ee6fefcb34ef2a8307b22322"}
Jul 14 17:03:20.548957 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.548912    2562 scope.go:117] "RemoveContainer" containerID="468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2"
Jul 14 17:03:20.564235 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.564217    2562 scope.go:117] "RemoveContainer" containerID="468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2"
Jul 14 17:03:20.564535 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:03:20.564515    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2\": container with ID starting with 468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2 not found: ID does not exist" containerID="468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2"
Jul 14 17:03:20.564624 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.564577    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2"} err="failed to get container status \"468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2\": rpc error: code = NotFound desc = could not find container \"468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2\": container with ID starting with 468c42f36b45baac231ff1986b53850207fcb37e8ffcebecf6505a1a03618ea2 not found: ID does not exist"
Jul 14 17:03:20.575763 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.575736    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"]
Jul 14 17:03:20.578827 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:20.578805    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/sub-test-model-314eb4-kserve-7b8fc77d9-msfnq"]
Jul 14 17:03:21.847614 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:21.847581    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e35ee428-f36c-44c1-b87a-cd3f29131b4d" path="/var/lib/kubelet/pods/e35ee428-f36c-44c1-b87a-cd3f29131b4d/volumes"
Jul 14 17:03:22.404654 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:22.404603    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:03:23.332758 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:23.332720    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:23.333144 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:23.332780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:23.345256 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:23.345223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:23.577097 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:23.577067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:03:33.409995 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.409961    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"]
Jul 14 17:03:33.410507 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.410487    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6769d916-8c86-4e2a-a09a-93e75f854c2c" containerName="main"
Jul 14 17:03:33.410593 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.410510    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6769d916-8c86-4e2a-a09a-93e75f854c2c" containerName="main"
Jul 14 17:03:33.410593 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.410543    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e35ee428-f36c-44c1-b87a-cd3f29131b4d" containerName="main"
Jul 14 17:03:33.410593 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.410552    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e35ee428-f36c-44c1-b87a-cd3f29131b4d" containerName="main"
Jul 14 17:03:33.410771 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.410676    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6769d916-8c86-4e2a-a09a-93e75f854c2c" containerName="main"
Jul 14 17:03:33.410771 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.410694    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e35ee428-f36c-44c1-b87a-cd3f29131b4d" containerName="main"
Jul 14 17:03:33.414064 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.414043    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.417036 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.417016    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"kube-root-ca.crt\""
Jul 14 17:03:33.418132 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.418115    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"default-dockercfg-928d6\""
Jul 14 17:03:33.418229 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.418153    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"openshift-service-ca.crt\""
Jul 14 17:03:33.418295 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.418261    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-314eb4\"/\"rate-test-model-314eb4-kserve-self-signed-certs\""
Jul 14 17:03:33.422881 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.422856    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"]
Jul 14 17:03:33.508487 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.508443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-dshm\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.508686 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.508538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-home\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.508686 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.508661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-model-cache\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.508773 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.508690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-tmp-dir\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.508773 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.508754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ec18ce-3b62-4530-8914-2cf96469b51d-tls-certs\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.508848 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.508786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592cp\" (UniqueName: \"kubernetes.io/projected/57ec18ce-3b62-4530-8914-2cf96469b51d-kube-api-access-592cp\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610296 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-model-cache\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610296 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610307    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-tmp-dir\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610513 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ec18ce-3b62-4530-8914-2cf96469b51d-tls-certs\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610513 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610388    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592cp\" (UniqueName: \"kubernetes.io/projected/57ec18ce-3b62-4530-8914-2cf96469b51d-kube-api-access-592cp\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610513 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-dshm\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610513 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610479    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-home\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610809 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610781    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-tmp-dir\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610869 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610818    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-model-cache\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.610911 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.610869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-home\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.612953 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.612932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-dshm\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.613452 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.613434    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ec18ce-3b62-4530-8914-2cf96469b51d-tls-certs\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.619730 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.619705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-592cp\" (UniqueName: \"kubernetes.io/projected/57ec18ce-3b62-4530-8914-2cf96469b51d-kube-api-access-592cp\") pod \"rate-test-model-314eb4-kserve-56d54bb4d7-r99t5\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") " pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.724288 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.724205    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:33.858246 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:33.858224    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"]
Jul 14 17:03:33.860524 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:03:33.860497    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57ec18ce_3b62_4530_8914_2cf96469b51d.slice/crio-85d6900598f93daf8b8bc884217fb7a26211ebc7b10934a2597c51c2610009d4 WatchSource:0}: Error finding container 85d6900598f93daf8b8bc884217fb7a26211ebc7b10934a2597c51c2610009d4: Status 404 returned error can't find the container with id 85d6900598f93daf8b8bc884217fb7a26211ebc7b10934a2597c51c2610009d4
Jul 14 17:03:34.622164 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:34.622125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5" event={"ID":"57ec18ce-3b62-4530-8914-2cf96469b51d","Type":"ContainerStarted","Data":"d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287"}
Jul 14 17:03:34.622488 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:34.622171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5" event={"ID":"57ec18ce-3b62-4530-8914-2cf96469b51d","Type":"ContainerStarted","Data":"85d6900598f93daf8b8bc884217fb7a26211ebc7b10934a2597c51c2610009d4"}
Jul 14 17:03:34.642093 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:34.642045    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5" podStartSLOduration=1.642030803 podStartE2EDuration="1.642030803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:03:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:03:34.640527116 +0000 UTC m=+2237.365155819" watchObservedRunningTime="2026-07-14 17:03:34.642030803 +0000 UTC m=+2237.366659504"
Jul 14 17:03:37.491132 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:37.491099    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:03:43.725297 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:43.725208    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:43.725297 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:43.725283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:43.737885 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:43.737865    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:44.681895 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:44.681866    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:03:55.317788 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:03:55.317754    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:04:09.282871 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:09.282835    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:04:15.114591 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:15.114558    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"]
Jul 14 17:04:15.949787 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:15.949750    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"]
Jul 14 17:04:17.963103 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:17.963076    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"]
Jul 14 17:04:17.963466 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:17.963328    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75" podUID="a022964a-e109-4277-b88b-7ce45fc0aad6" containerName="maas-api" containerID="cri-o://a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781" gracePeriod=30
Jul 14 17:04:18.000154 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.000128    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"]
Jul 14 17:04:18.002889 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.002867    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-584665-29734140-x7v5m"]
Jul 14 17:04:18.211927 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.211871    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 17:04:18.303377 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.303349    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a022964a-e109-4277-b88b-7ce45fc0aad6-openshift-service-ca\") pod \"a022964a-e109-4277-b88b-7ce45fc0aad6\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") "
Jul 14 17:04:18.303565 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.303425    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mdjp\" (UniqueName: \"kubernetes.io/projected/a022964a-e109-4277-b88b-7ce45fc0aad6-kube-api-access-7mdjp\") pod \"a022964a-e109-4277-b88b-7ce45fc0aad6\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") "
Jul 14 17:04:18.303565 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.303494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls\") pod \"a022964a-e109-4277-b88b-7ce45fc0aad6\" (UID: \"a022964a-e109-4277-b88b-7ce45fc0aad6\") "
Jul 14 17:04:18.303748 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.303723    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a022964a-e109-4277-b88b-7ce45fc0aad6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a022964a-e109-4277-b88b-7ce45fc0aad6" (UID: "a022964a-e109-4277-b88b-7ce45fc0aad6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 14 17:04:18.303861 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.303844    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a022964a-e109-4277-b88b-7ce45fc0aad6-openshift-service-ca\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:18.305731 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.305706    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a022964a-e109-4277-b88b-7ce45fc0aad6" (UID: "a022964a-e109-4277-b88b-7ce45fc0aad6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:04:18.305840 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.305764    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a022964a-e109-4277-b88b-7ce45fc0aad6-kube-api-access-7mdjp" (OuterVolumeSpecName: "kube-api-access-7mdjp") pod "a022964a-e109-4277-b88b-7ce45fc0aad6" (UID: "a022964a-e109-4277-b88b-7ce45fc0aad6"). InnerVolumeSpecName "kube-api-access-7mdjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:04:18.405225 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.405192    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mdjp\" (UniqueName: \"kubernetes.io/projected/a022964a-e109-4277-b88b-7ce45fc0aad6-kube-api-access-7mdjp\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:18.405225 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.405218    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a022964a-e109-4277-b88b-7ce45fc0aad6-maas-api-tls\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:18.839983 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.839942    2562 generic.go:356] "Generic (PLEG): container finished" podID="a022964a-e109-4277-b88b-7ce45fc0aad6" containerID="a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781" exitCode=0
Jul 14 17:04:18.840152 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.839990    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"
Jul 14 17:04:18.840152 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.840022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75" event={"ID":"a022964a-e109-4277-b88b-7ce45fc0aad6","Type":"ContainerDied","Data":"a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781"}
Jul 14 17:04:18.840152 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.840077    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75" event={"ID":"a022964a-e109-4277-b88b-7ce45fc0aad6","Type":"ContainerDied","Data":"23696aba65a79e0fe07dc8ac70dd739cbb78eed9d51cb3c5a7b5d7944e375e65"}
Jul 14 17:04:18.840152 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.840099    2562 scope.go:117] "RemoveContainer" containerID="a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781"
Jul 14 17:04:18.849844 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.849825    2562 scope.go:117] "RemoveContainer" containerID="a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781"
Jul 14 17:04:18.850098 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:04:18.850079    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781\": container with ID starting with a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781 not found: ID does not exist" containerID="a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781"
Jul 14 17:04:18.850174 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.850107    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781"} err="failed to get container status \"a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781\": rpc error: code = NotFound desc = could not find container \"a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781\": container with ID starting with a1c9f630ae7b03eacadcf90bc40f4f44ddef99bc2558d6cde2cac93454ea3781 not found: ID does not exist"
Jul 14 17:04:18.871982 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.871951    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"]
Jul 14 17:04:18.878789 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:18.878767    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-584665-76f6999878-dzt75"]
Jul 14 17:04:19.847108 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:19.847075    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a022964a-e109-4277-b88b-7ce45fc0aad6" path="/var/lib/kubelet/pods/a022964a-e109-4277-b88b-7ce45fc0aad6/volumes"
Jul 14 17:04:19.847476 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:19.847395    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be2ead3c-1a4f-4802-b175-2e8f9ddb12f0" path="/var/lib/kubelet/pods/be2ead3c-1a4f-4802-b175-2e8f9ddb12f0/volumes"
Jul 14 17:04:27.589324 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:27.589289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:04:30.134523 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.134451    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd" podUID="ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" containerName="main" containerID="cri-o://d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3" gracePeriod=45
Jul 14 17:04:30.381939 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.381909    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:04:30.515252 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515175    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf4h4\" (UniqueName: \"kubernetes.io/projected/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-kube-api-access-xf4h4\") pod \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") "
Jul 14 17:04:30.515252 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515217    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tls-certs\") pod \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") "
Jul 14 17:04:30.515252 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515239    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-model-cache\") pod \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") "
Jul 14 17:04:30.515527 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515269    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tmp-dir\") pod \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") "
Jul 14 17:04:30.515527 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-dshm\") pod \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") "
Jul 14 17:04:30.515527 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-home\") pod \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\" (UID: \"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9\") "
Jul 14 17:04:30.515720 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-model-cache" (OuterVolumeSpecName: "model-cache") pod "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" (UID: "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:30.515720 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515657    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" (UID: "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:30.515720 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515681    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-home" (OuterVolumeSpecName: "home") pod "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" (UID: "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:30.515720 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.515698    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:30.517607 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.517569    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-dshm" (OuterVolumeSpecName: "dshm") pod "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" (UID: "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:30.517754 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.517611    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-kube-api-access-xf4h4" (OuterVolumeSpecName: "kube-api-access-xf4h4") pod "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" (UID: "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9"). InnerVolumeSpecName "kube-api-access-xf4h4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:04:30.517754 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.517679    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" (UID: "ab0856b2-cc96-425e-aaf6-b8bf95f33bf9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:04:30.616417 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.616366    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:30.616417 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.616411    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:30.616417 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.616425    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf4h4\" (UniqueName: \"kubernetes.io/projected/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-kube-api-access-xf4h4\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:30.616691 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.616440    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:30.616691 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.616453    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:30.897953 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.897917    2562 generic.go:356] "Generic (PLEG): container finished" podID="ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" containerID="d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3" exitCode=0
Jul 14 17:04:30.898113 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.897956    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"
Jul 14 17:04:30.898113 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.898003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd" event={"ID":"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9","Type":"ContainerDied","Data":"d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3"}
Jul 14 17:04:30.898113 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.898045    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd" event={"ID":"ab0856b2-cc96-425e-aaf6-b8bf95f33bf9","Type":"ContainerDied","Data":"9c530b654ccd414b77aea653d146b3dff6fd5c534e6e9a0e9dade139991b052e"}
Jul 14 17:04:30.898113 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.898062    2562 scope.go:117] "RemoveContainer" containerID="d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3"
Jul 14 17:04:30.907319 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.907299    2562 scope.go:117] "RemoveContainer" containerID="d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3"
Jul 14 17:04:30.907568 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:04:30.907548    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3\": container with ID starting with d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3 not found: ID does not exist" containerID="d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3"
Jul 14 17:04:30.907613 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.907580    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3"} err="failed to get container status \"d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3\": rpc error: code = NotFound desc = could not find container \"d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3\": container with ID starting with d9b7b1bffa90adce3e010402581f0bf25e5a7559b5ef20ea6d000cc02d8367e3 not found: ID does not exist"
Jul 14 17:04:30.919616 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.919585    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"]
Jul 14 17:04:30.925388 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.925366    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-584665/rate-test-model-584665-kserve-77fc6b7755-sn8fd"]
Jul 14 17:04:30.970209 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:30.970145    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5" podUID="57ec18ce-3b62-4530-8914-2cf96469b51d" containerName="main" containerID="cri-o://d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287" gracePeriod=45
Jul 14 17:04:31.220715 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.220684    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:04:31.323483 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ec18ce-3b62-4530-8914-2cf96469b51d-tls-certs\") pod \"57ec18ce-3b62-4530-8914-2cf96469b51d\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") "
Jul 14 17:04:31.323699 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323514    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-home\") pod \"57ec18ce-3b62-4530-8914-2cf96469b51d\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") "
Jul 14 17:04:31.323699 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-592cp\" (UniqueName: \"kubernetes.io/projected/57ec18ce-3b62-4530-8914-2cf96469b51d-kube-api-access-592cp\") pod \"57ec18ce-3b62-4530-8914-2cf96469b51d\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") "
Jul 14 17:04:31.323699 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323570    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-dshm\") pod \"57ec18ce-3b62-4530-8914-2cf96469b51d\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") "
Jul 14 17:04:31.323699 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323605    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-tmp-dir\") pod \"57ec18ce-3b62-4530-8914-2cf96469b51d\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") "
Jul 14 17:04:31.323699 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-model-cache\") pod \"57ec18ce-3b62-4530-8914-2cf96469b51d\" (UID: \"57ec18ce-3b62-4530-8914-2cf96469b51d\") "
Jul 14 17:04:31.323945 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323833    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-home" (OuterVolumeSpecName: "home") pod "57ec18ce-3b62-4530-8914-2cf96469b51d" (UID: "57ec18ce-3b62-4530-8914-2cf96469b51d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:31.323945 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323900    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57ec18ce-3b62-4530-8914-2cf96469b51d" (UID: "57ec18ce-3b62-4530-8914-2cf96469b51d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:31.324048 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.323997    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-tmp-dir\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:31.324048 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.324018    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-home\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:31.324048 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.324001    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-model-cache" (OuterVolumeSpecName: "model-cache") pod "57ec18ce-3b62-4530-8914-2cf96469b51d" (UID: "57ec18ce-3b62-4530-8914-2cf96469b51d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:31.325933 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.325910    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ec18ce-3b62-4530-8914-2cf96469b51d-kube-api-access-592cp" (OuterVolumeSpecName: "kube-api-access-592cp") pod "57ec18ce-3b62-4530-8914-2cf96469b51d" (UID: "57ec18ce-3b62-4530-8914-2cf96469b51d"). InnerVolumeSpecName "kube-api-access-592cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 14 17:04:31.326195 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.326177    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-dshm" (OuterVolumeSpecName: "dshm") pod "57ec18ce-3b62-4530-8914-2cf96469b51d" (UID: "57ec18ce-3b62-4530-8914-2cf96469b51d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 14 17:04:31.326195 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.326182    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ec18ce-3b62-4530-8914-2cf96469b51d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57ec18ce-3b62-4530-8914-2cf96469b51d" (UID: "57ec18ce-3b62-4530-8914-2cf96469b51d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 14 17:04:31.424965 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.424900    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-model-cache\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:31.424965 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.424922    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57ec18ce-3b62-4530-8914-2cf96469b51d-tls-certs\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:31.424965 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.424932    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-592cp\" (UniqueName: \"kubernetes.io/projected/57ec18ce-3b62-4530-8914-2cf96469b51d-kube-api-access-592cp\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:31.424965 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.424941    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57ec18ce-3b62-4530-8914-2cf96469b51d-dshm\") on node \"ip-10-0-142-177.ec2.internal\" DevicePath \"\""
Jul 14 17:04:31.848532 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.848448    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" path="/var/lib/kubelet/pods/ab0856b2-cc96-425e-aaf6-b8bf95f33bf9/volumes"
Jul 14 17:04:31.905804 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.905766    2562 generic.go:356] "Generic (PLEG): container finished" podID="57ec18ce-3b62-4530-8914-2cf96469b51d" containerID="d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287" exitCode=0
Jul 14 17:04:31.905943 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.905810    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"
Jul 14 17:04:31.905943 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.905822    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5" event={"ID":"57ec18ce-3b62-4530-8914-2cf96469b51d","Type":"ContainerDied","Data":"d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287"}
Jul 14 17:04:31.905943 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.905859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5" event={"ID":"57ec18ce-3b62-4530-8914-2cf96469b51d","Type":"ContainerDied","Data":"85d6900598f93daf8b8bc884217fb7a26211ebc7b10934a2597c51c2610009d4"}
Jul 14 17:04:31.905943 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.905881    2562 scope.go:117] "RemoveContainer" containerID="d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287"
Jul 14 17:04:31.917759 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.916135    2562 scope.go:117] "RemoveContainer" containerID="d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287"
Jul 14 17:04:31.918010 ip-10-0-142-177 kubenswrapper[2562]: E0714 17:04:31.917978    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287\": container with ID starting with d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287 not found: ID does not exist" containerID="d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287"
Jul 14 17:04:31.918101 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.918021    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287"} err="failed to get container status \"d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287\": rpc error: code = NotFound desc = could not find container \"d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287\": container with ID starting with d35c8d9d8fa439d6ec9f3d3d3d2d4358474fe67f3722ca324cdda21b1a6ee287 not found: ID does not exist"
Jul 14 17:04:31.925479 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.925457    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"]
Jul 14 17:04:31.928747 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:31.928722    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-314eb4/rate-test-model-314eb4-kserve-56d54bb4d7-r99t5"]
Jul 14 17:04:33.848805 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:04:33.848761    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ec18ce-3b62-4530-8914-2cf96469b51d" path="/var/lib/kubelet/pods/57ec18ce-3b62-4530-8914-2cf96469b51d/volumes"
Jul 14 17:05:03.385096 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:03.385060    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-d87xj"]
Jul 14 17:05:13.708960 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:13.708875    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vlz4h_e883019f-a78d-4509-8a71-4dbbf9a877fa/manager/0.log"
Jul 14 17:05:13.938296 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:13.938265    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734125-fzhwx_59aa37dd-a04d-4a66-a573-218a88426f5b/cleanup/0.log"
Jul 14 17:05:14.530577 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:14.530545    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-8z9lf_b47f0b7d-a184-419b-8f1c-74e2508be8bb/copy-manifests/0.log"
Jul 14 17:05:14.540174 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:14.540150    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-8z9lf_b47f0b7d-a184-419b-8f1c-74e2508be8bb/manager/0.log"
Jul 14 17:05:17.007292 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:17.007266    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d87xj_74866255-375a-4fbf-ab16-a13abcc5b37f/limitador/0.log"
Jul 14 17:05:17.729511 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:17.729486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-bz5fd_763f3fe6-28bd-4831-a979-740c853ac812/kube-auth-proxy/0.log"
Jul 14 17:05:19.006083 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:19.006043    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbspxc2_a5299cf0-2cc3-4dac-bec5-d7741d6e1a8d/main/0.log"
Jul 14 17:05:23.847666 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.847600    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnx7p/must-gather-nk9hz"]
Jul 14 17:05:23.848205 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848156    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ec18ce-3b62-4530-8914-2cf96469b51d" containerName="main"
Jul 14 17:05:23.848205 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848174    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ec18ce-3b62-4530-8914-2cf96469b51d" containerName="main"
Jul 14 17:05:23.848205 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848192    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" containerName="main"
Jul 14 17:05:23.848205 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848200    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" containerName="main"
Jul 14 17:05:23.848427 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848214    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a022964a-e109-4277-b88b-7ce45fc0aad6" containerName="maas-api"
Jul 14 17:05:23.848427 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848222    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a022964a-e109-4277-b88b-7ce45fc0aad6" containerName="maas-api"
Jul 14 17:05:23.848427 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848318    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ec18ce-3b62-4530-8914-2cf96469b51d" containerName="main"
Jul 14 17:05:23.848427 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848331    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab0856b2-cc96-425e-aaf6-b8bf95f33bf9" containerName="main"
Jul 14 17:05:23.848427 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.848342    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a022964a-e109-4277-b88b-7ce45fc0aad6" containerName="maas-api"
Jul 14 17:05:23.851240 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.851220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:23.854001 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.853984    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnx7p\"/\"kube-root-ca.crt\""
Jul 14 17:05:23.855587 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.855567    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jnx7p\"/\"default-dockercfg-sn9px\""
Jul 14 17:05:23.855805 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.855783    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jnx7p\"/\"openshift-service-ca.crt\""
Jul 14 17:05:23.857977 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.857959    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnx7p/must-gather-nk9hz"]
Jul 14 17:05:23.889257 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.889231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/63fc5e1e-fc19-4c0d-b92a-855b8b96bca8-must-gather-output\") pod \"must-gather-nk9hz\" (UID: \"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8\") " pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:23.889347 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.889275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwq5z\" (UniqueName: \"kubernetes.io/projected/63fc5e1e-fc19-4c0d-b92a-855b8b96bca8-kube-api-access-mwq5z\") pod \"must-gather-nk9hz\" (UID: \"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8\") " pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:23.990238 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.990211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/63fc5e1e-fc19-4c0d-b92a-855b8b96bca8-must-gather-output\") pod \"must-gather-nk9hz\" (UID: \"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8\") " pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:23.990330 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.990266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwq5z\" (UniqueName: \"kubernetes.io/projected/63fc5e1e-fc19-4c0d-b92a-855b8b96bca8-kube-api-access-mwq5z\") pod \"must-gather-nk9hz\" (UID: \"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8\") " pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:23.990503 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:23.990486    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/63fc5e1e-fc19-4c0d-b92a-855b8b96bca8-must-gather-output\") pod \"must-gather-nk9hz\" (UID: \"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8\") " pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:24.000351 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:24.000327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwq5z\" (UniqueName: \"kubernetes.io/projected/63fc5e1e-fc19-4c0d-b92a-855b8b96bca8-kube-api-access-mwq5z\") pod \"must-gather-nk9hz\" (UID: \"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8\") " pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:24.161119 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:24.161100    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnx7p/must-gather-nk9hz"
Jul 14 17:05:24.291037 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:24.291014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnx7p/must-gather-nk9hz"]
Jul 14 17:05:24.293080 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:05:24.293056    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63fc5e1e_fc19_4c0d_b92a_855b8b96bca8.slice/crio-bba06a97843098003a63c7951515d4f6e120cf178dcce16e6cd3968c152fe561 WatchSource:0}: Error finding container bba06a97843098003a63c7951515d4f6e120cf178dcce16e6cd3968c152fe561: Status 404 returned error can't find the container with id bba06a97843098003a63c7951515d4f6e120cf178dcce16e6cd3968c152fe561
Jul 14 17:05:24.294818 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:24.294802    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 14 17:05:25.167951 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:25.167921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/must-gather-nk9hz" event={"ID":"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8","Type":"ContainerStarted","Data":"bba06a97843098003a63c7951515d4f6e120cf178dcce16e6cd3968c152fe561"}
Jul 14 17:05:26.177143 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:26.177107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/must-gather-nk9hz" event={"ID":"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8","Type":"ContainerStarted","Data":"143583aad1f2359c2d868e8788e76edf1847e9969a6ea1d166bd847e2d5a6f68"}
Jul 14 17:05:26.177700 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:26.177669    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/must-gather-nk9hz" event={"ID":"63fc5e1e-fc19-4c0d-b92a-855b8b96bca8","Type":"ContainerStarted","Data":"dc823c605ad15f8581a1b1880f45599b4c8725a273ca99c9094bfdec1c3b998c"}
Jul 14 17:05:26.196973 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:26.196908    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnx7p/must-gather-nk9hz" podStartSLOduration=2.285594802 podStartE2EDuration="3.196888696s" totalImagesPullingTime="911.293894ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 17:05:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:05:26.19381507 +0000 UTC m=+2348.918443773" watchObservedRunningTime="2026-07-14 17:05:26.196888696 +0000 UTC m=+2348.921517399"
Jul 14 17:05:26.798729 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:26.798687    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ns64l_8f9a1ebc-d7b4-4a0b-b765-4b3fbb574f37/global-pull-secret-syncer/0.log"
Jul 14 17:05:26.927961 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:26.927934    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wlvlv_9ebefff4-01a4-4dc0-85bb-9e0ec0fbcee5/konnectivity-agent/0.log"
Jul 14 17:05:26.998394 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:26.998362    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-177.ec2.internal_8d609c1ee768fe3daa3f23cbaf1c3121/haproxy/0.log"
Jul 14 17:05:32.439885 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:32.439851    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-d87xj_74866255-375a-4fbf-ab16-a13abcc5b37f/limitador/0.log"
Jul 14 17:05:34.088809 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.088708    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/alertmanager/0.log"
Jul 14 17:05:34.111454 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.111427    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/config-reloader/0.log"
Jul 14 17:05:34.135955 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.135922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/kube-rbac-proxy-web/0.log"
Jul 14 17:05:34.158672 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.158626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/kube-rbac-proxy/0.log"
Jul 14 17:05:34.180753 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.180725    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/kube-rbac-proxy-metric/0.log"
Jul 14 17:05:34.206306 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.206278    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/prom-label-proxy/0.log"
Jul 14 17:05:34.237444 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.237418    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8729bcf9-2c8f-4d8c-9f89-73fb57e1d3c2/init-config-reloader/0.log"
Jul 14 17:05:34.306656 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.305772    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-j5qhv_7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f/kube-state-metrics/0.log"
Jul 14 17:05:34.339609 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.339528    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-j5qhv_7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f/kube-rbac-proxy-main/0.log"
Jul 14 17:05:34.387871 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.387841    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-j5qhv_7cc69c94-a4a6-4c47-ac2e-a3bfb608af3f/kube-rbac-proxy-self/0.log"
Jul 14 17:05:34.444281 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.444244    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7867cc67fd-z558f_8c09be30-9a09-43ba-9d89-bcc0b40e9322/metrics-server/0.log"
Jul 14 17:05:34.491813 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.491781    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-z8r6f_59d15d4d-26ad-42ee-ac87-3e90c3d928f9/monitoring-plugin/0.log"
Jul 14 17:05:34.680408 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.680358    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xtd5m_5716100f-473f-49e3-a249-bede6e678744/node-exporter/0.log"
Jul 14 17:05:34.701490 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.701444    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xtd5m_5716100f-473f-49e3-a249-bede6e678744/kube-rbac-proxy/0.log"
Jul 14 17:05:34.740344 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.740320    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xtd5m_5716100f-473f-49e3-a249-bede6e678744/init-textfile/0.log"
Jul 14 17:05:34.786686 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.785026    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-m94mg_7f5588b0-0938-4f61-9b0d-b593c368af43/kube-rbac-proxy-main/0.log"
Jul 14 17:05:34.821347 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.821281    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-m94mg_7f5588b0-0938-4f61-9b0d-b593c368af43/kube-rbac-proxy-self/0.log"
Jul 14 17:05:34.858225 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.858182    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-m94mg_7f5588b0-0938-4f61-9b0d-b593c368af43/openshift-state-metrics/0.log"
Jul 14 17:05:34.914095 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.914063    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/prometheus/0.log"
Jul 14 17:05:34.949174 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.949090    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/config-reloader/0.log"
Jul 14 17:05:34.991166 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:34.991136    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/thanos-sidecar/0.log"
Jul 14 17:05:35.030959 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.030918    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/kube-rbac-proxy-web/0.log"
Jul 14 17:05:35.068921 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.068892    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/kube-rbac-proxy/0.log"
Jul 14 17:05:35.106044 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.106003    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/kube-rbac-proxy-thanos/0.log"
Jul 14 17:05:35.139877 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.139847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ac079e17-8f27-494b-8b90-253bfc4acad3/init-config-reloader/0.log"
Jul 14 17:05:35.183744 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.183705    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-72gwt_ab906c62-c91c-4283-8eca-3c192f9b0f38/prometheus-operator/0.log"
Jul 14 17:05:35.234296 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.234208    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-72gwt_ab906c62-c91c-4283-8eca-3c192f9b0f38/kube-rbac-proxy/0.log"
Jul 14 17:05:35.314184 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.314149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655f464c76-wc9h5_c7375c41-8a97-4b3b-b82a-ee9c9706db1b/telemeter-client/0.log"
Jul 14 17:05:35.350308 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.350277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655f464c76-wc9h5_c7375c41-8a97-4b3b-b82a-ee9c9706db1b/reload/0.log"
Jul 14 17:05:35.382292 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.382261    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-655f464c76-wc9h5_c7375c41-8a97-4b3b-b82a-ee9c9706db1b/kube-rbac-proxy/0.log"
Jul 14 17:05:35.425356 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.425327    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58ccf5b798-7954g_a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb/thanos-query/0.log"
Jul 14 17:05:35.467884 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.467847    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58ccf5b798-7954g_a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb/kube-rbac-proxy-web/0.log"
Jul 14 17:05:35.519953 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.519859    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58ccf5b798-7954g_a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb/kube-rbac-proxy/0.log"
Jul 14 17:05:35.582625 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.582595    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58ccf5b798-7954g_a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb/prom-label-proxy/0.log"
Jul 14 17:05:35.625230 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.625199    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58ccf5b798-7954g_a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb/kube-rbac-proxy-rules/0.log"
Jul 14 17:05:35.664987 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:35.664956    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58ccf5b798-7954g_a35a3c4b-02ba-43b7-a8a7-11aabc15d4cb/kube-rbac-proxy-metrics/0.log"
Jul 14 17:05:36.758694 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.758614    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"]
Jul 14 17:05:36.762382 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.762356    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.780715 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.780690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"]
Jul 14 17:05:36.829923 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.829886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-proc\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.830209 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.830156    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-sys\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.830356 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.830330    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-lib-modules\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.830427 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.830391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-podres\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.830487 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.830436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6lg9\" (UniqueName: \"kubernetes.io/projected/9e5f818a-39bb-49a1-b980-78606f60c774-kube-api-access-t6lg9\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.931678 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.931610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-podres\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.931850 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.931693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6lg9\" (UniqueName: \"kubernetes.io/projected/9e5f818a-39bb-49a1-b980-78606f60c774-kube-api-access-t6lg9\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.931850 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.931778    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-proc\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.931850 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.931809    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-sys\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.931979 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.931899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-lib-modules\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.932100 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.932084    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-lib-modules\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.932196 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.932180    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-podres\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.932565 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.932546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-proc\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.932620 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.932606    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e5f818a-39bb-49a1-b980-78606f60c774-sys\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:36.942458 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:36.942420    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6lg9\" (UniqueName: \"kubernetes.io/projected/9e5f818a-39bb-49a1-b980-78606f60c774-kube-api-access-t6lg9\") pod \"perf-node-gather-daemonset-fd5sh\" (UID: \"9e5f818a-39bb-49a1-b980-78606f60c774\") " pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:37.075620 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:37.075545    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:37.262326 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:37.259980    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"]
Jul 14 17:05:37.262464 ip-10-0-142-177 kubenswrapper[2562]: W0714 17:05:37.262404    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9e5f818a_39bb_49a1_b980_78606f60c774.slice/crio-c1f6686f65364dd2e4b0a0ed029d752d55848c273868f2fe2d73ba781b8ea2d8 WatchSource:0}: Error finding container c1f6686f65364dd2e4b0a0ed029d752d55848c273868f2fe2d73ba781b8ea2d8: Status 404 returned error can't find the container with id c1f6686f65364dd2e4b0a0ed029d752d55848c273868f2fe2d73ba781b8ea2d8
Jul 14 17:05:38.263223 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:38.263182    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh" event={"ID":"9e5f818a-39bb-49a1-b980-78606f60c774","Type":"ContainerStarted","Data":"0e3fcee90e759529370a4e6adfae0f5583a7df3ac4f79e98c2d0052f584053b6"}
Jul 14 17:05:38.263727 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:38.263253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh" event={"ID":"9e5f818a-39bb-49a1-b980-78606f60c774","Type":"ContainerStarted","Data":"c1f6686f65364dd2e4b0a0ed029d752d55848c273868f2fe2d73ba781b8ea2d8"}
Jul 14 17:05:38.263727 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:38.263284    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:38.282663 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:38.282595    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh" podStartSLOduration=2.282579824 podStartE2EDuration="2.282579824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 17:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 17:05:38.279688158 +0000 UTC m=+2361.004316852" watchObservedRunningTime="2026-07-14 17:05:38.282579824 +0000 UTC m=+2361.007208524"
Jul 14 17:05:39.580315 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:39.580285    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4nvl4_11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c/dns/0.log"
Jul 14 17:05:39.602011 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:39.601989    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4nvl4_11a95e67-e8d0-4d06-a3f1-ddf1e4b93c1c/kube-rbac-proxy/0.log"
Jul 14 17:05:39.667271 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:39.667245    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-854nf_7278d9b5-8535-4dde-9d3f-7959c2f50a3c/dns-node-resolver/0.log"
Jul 14 17:05:40.292402 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:40.292368    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mqbzt_52a40b3f-8e71-4eca-901f-a4e50ee4f07f/node-ca/0.log"
Jul 14 17:05:41.323399 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:41.323308    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-bz5fd_763f3fe6-28bd-4831-a979-740c853ac812/kube-auth-proxy/0.log"
Jul 14 17:05:42.170922 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:42.170889    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-klcjr_e5f48a34-04a2-443e-a6bc-5efb622f0eed/serve-healthcheck-canary/0.log"
Jul 14 17:05:42.824824 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:42.824782    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s7tn4_ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc/kube-rbac-proxy/0.log"
Jul 14 17:05:42.845098 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:42.845050    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s7tn4_ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc/exporter/0.log"
Jul 14 17:05:42.868216 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:42.868189    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s7tn4_ac34b948-5b0c-4b1b-a3a7-dd50e775a7fc/extractor/0.log"
Jul 14 17:05:44.280411 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:44.280374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jnx7p/perf-node-gather-daemonset-fd5sh"
Jul 14 17:05:45.170970 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:45.170936    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-vlz4h_e883019f-a78d-4509-8a71-4dbbf9a877fa/manager/0.log"
Jul 14 17:05:45.248323 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:45.248289    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29734125-fzhwx_59aa37dd-a04d-4a66-a573-218a88426f5b/cleanup/0.log"
Jul 14 17:05:45.531309 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:45.531202    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-8z9lf_b47f0b7d-a184-419b-8f1c-74e2508be8bb/manager/0.log"
Jul 14 17:05:45.556097 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:45.556067    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b6f9446cf-8z9lf_b47f0b7d-a184-419b-8f1c-74e2508be8bb/copy-manifests/0.log"
Jul 14 17:05:47.160406 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:47.160372    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-bz5fd_763f3fe6-28bd-4831-a979-740c853ac812/kube-auth-proxy/0.log"
Jul 14 17:05:47.236391 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:47.236348    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-54bc77f658-7pgmg_8b81ecc1-55b3-4edf-b461-321748d55765/manager/0.log"
Jul 14 17:05:47.319551 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:47.319519    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-nrxhx_feefb75a-c6af-4ec1-a238-7b1b9855b40d/openshift-lws-operator/0.log"
Jul 14 17:05:48.787450 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:48.787378    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75f7bf6bc6-bz5fd_763f3fe6-28bd-4831-a979-740c853ac812/kube-auth-proxy/0.log"
Jul 14 17:05:53.884127 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:53.884098    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/kube-multus-additional-cni-plugins/0.log"
Jul 14 17:05:53.906278 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:53.906240    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/egress-router-binary-copy/0.log"
Jul 14 17:05:53.926651 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:53.926603    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/cni-plugins/0.log"
Jul 14 17:05:53.946806 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:53.946777    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/bond-cni-plugin/0.log"
Jul 14 17:05:53.968884 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:53.968850    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/routeoverride-cni/0.log"
Jul 14 17:05:53.992972 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:53.992942    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/whereabouts-cni-bincopy/0.log"
Jul 14 17:05:54.012399 ip-10-0-142-177 kubenswrapper[2562]: I0714 17:05:54.012379    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wwlbg_693784c9-ac94-46a6-9414-8fbe3dcc2cc3/whereabouts-cni/0.log"