Jul 23 13:15:56.002865 ip-10-0-141-235 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 13:15:56.002877 ip-10-0-141-235 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 13:15:56.002886 ip-10-0-141-235 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 13:15:56.003371 ip-10-0-141-235 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 13:16:05.384234 ip-10-0-141-235 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 23 13:16:05.384251 ip-10-0-141-235 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot f0d0cf43e96248de922f9587f2297c21 --
Jul 23 13:17:34.792117 ip-10-0-141-235 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 13:17:35.245665 ip-10-0-141-235 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:17:35.245665 ip-10-0-141-235 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 13:17:35.245665 ip-10-0-141-235 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:17:35.245665 ip-10-0-141-235 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 13:17:35.245665 ip-10-0-141-235 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 13:17:35.246716 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.246627    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 13:17:35.251567 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251551    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:17:35.251567 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251567    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251570    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251574    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251580    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251584    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251587    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251590    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251593    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251596    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251598    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251601    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251603    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251612    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251615    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251617    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251620    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251622    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251625    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251627    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:17:35.251635 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251630    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251632    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251635    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251638    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251640    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251643    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251646    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251648    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251651    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251654    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251657    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251659    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251662    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251664    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251667    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251669    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251671    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251674    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251676    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:17:35.252136 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251678    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251681    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251683    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251686    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251688    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251690    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251693    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251696    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251698    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251701    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251703    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251705    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251708    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251710    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251712    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251716    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251719    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251721    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251723    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251726    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:17:35.252589 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251728    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251732    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251734    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251736    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251739    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251741    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251744    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251746    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251748    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251751    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251753    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251756    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251758    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251760    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251763    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251766    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251768    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251770    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251774    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:17:35.253101 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251777    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251782    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251785    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251788    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251791    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251793    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251796    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251798    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251802    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251804    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251807    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251814    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251818    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251821    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251824    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251826    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251829    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251831    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251834    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251852    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:17:35.253543 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.251854    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252565    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252571    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252573    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252576    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252578    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252581    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252584    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252586    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252589    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252591    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252594    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252596    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252599    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252605    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252608    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252611    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252614    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252617    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252619    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252623    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:17:35.254036 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252626    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252628    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252631    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252633    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252637    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252641    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252644    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252647    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252649    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252652    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252656    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252659    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252662    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252665    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252668    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252671    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252674    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252676    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:17:35.254662 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252680    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252682    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252685    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252687    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252690    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252692    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252695    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252697    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252705    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252708    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252711    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252714    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252716    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252719    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252722    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252724    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252726    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252729    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252731    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252734    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:17:35.255451 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252736    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252738    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252741    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252743    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252745    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252748    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252750    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252752    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252755    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252757    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252759    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252762    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252767    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252770    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252773    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252775    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252778    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252781    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252783    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:17:35.256193 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252786    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252788    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252794    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252796    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252799    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252802    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252805    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252807    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252809    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252812    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252814    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252816    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252819    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252821    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252824    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252826    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252828    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252831    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252833    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:17:35.256683 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252852    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252854    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.252857    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253277    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253281    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253284    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253287    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253289    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253293    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253295    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253298    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253300    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253303    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253305    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253308    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253311    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253314    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253316    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253319    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253322    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:17:35.257294 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253324    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253327    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253329    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253332    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253334    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253337    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253339    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253341    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253344    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253347    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253349    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253351    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253354    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253356    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253359    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253361    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253364    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253366    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253368    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:17:35.257818 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253370    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253373    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253376    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253378    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253381    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253384    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253386    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253389    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253391    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253394    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253396    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253403    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253406    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253408    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253410    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253413    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253415    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253418    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253420    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253422    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:17:35.258522 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253425    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253427    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253430    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253432    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253434    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253437    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253439    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253442    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253444    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253447    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253450    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253452    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253454    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253457    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253459    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253462    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253465    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253467    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253470    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253473    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:17:35.259129 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253477    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253480    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253489    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253494    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253497    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253500    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253503    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253506    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253509    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253512    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253514    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253516    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253519    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253521    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253524    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253526    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253528    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253531    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253533    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:17:35.259747 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253541    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253544    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253547    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.253550    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253622    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253629    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253640    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253645    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253649    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253652    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253656    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253660    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253663    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253666    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253670    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253673    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253684    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253687    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253689    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253692    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253695    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253698    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253708    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253710    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 13:17:35.260220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253713    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253716    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253723    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253726    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253729    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253732    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253736    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253738    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253741    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253745    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253748    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253751    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253755    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253758    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253760    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253763    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253766    2581 flags.go:64] FLAG: --enable-server="true"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253768    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253774    2581 flags.go:64] FLAG: --event-burst="100"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253777    2581 flags.go:64] FLAG: --event-qps="50"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253780    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253783    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253786    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253789    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 13:17:35.260806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253794    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253803    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253806    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253809    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253811    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253814    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253817    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253820    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253823    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253825    2581 flags.go:64] FLAG: --feature-gates=""
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253829    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253832    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253847    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253851    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253854    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253857    2581 flags.go:64] FLAG: --help="false"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253860    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253865    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253867    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253870    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253874    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253877    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253880    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 13:17:35.261411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253882    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253885    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253888    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253890    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253893    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253896    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253900    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253902    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253905    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253909    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253911    2581 flags.go:64] FLAG: --lock-file=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253921    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253924    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253927    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253932    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253935    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253937    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253940    2581 flags.go:64] FLAG: --logging-format="text"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253943    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253946    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253949    2581 flags.go:64] FLAG: --manifest-url=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253951    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253956    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253958    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253963    2581 flags.go:64] FLAG: --max-pods="110"
Jul 23 13:17:35.262001 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253965    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253969    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253972    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253975    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253977    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253980    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253983    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253990    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253992    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253995    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.253998    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254000    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254009    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254012    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254014    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254017    2581 flags.go:64] FLAG: --port="10250"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254027    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254030    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06616eae2116ca0e6"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254033    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254041    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254044    2581 flags.go:64] FLAG: --register-node="true"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254047    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254050    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254053    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 23 13:17:35.262616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254056    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254058    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254062    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254065    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254068    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254070    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254073    2581 flags.go:64] FLAG: --runonce="false"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254075    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254078    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254081    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254085    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254087    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254090    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254093    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254096    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254098    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254101    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254104    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254106    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254109    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254112    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254114    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254119    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254122    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254125    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 13:17:35.263346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254131    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254134    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254137    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254145    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254148    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254151    2581 flags.go:64] FLAG: --v="2"
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254154    2581 flags.go:64] FLAG: --version="false"
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254158    2581 flags.go:64] FLAG: --vmodule=""
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254162    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.254165    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255225    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255238    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255243    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255247    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255253    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255257    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255262    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255269    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255274    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255278    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255288    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255292    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:17:35.263973 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255296    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255300    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255305    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255309    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255313    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255317    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255323    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255329    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255333    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255338    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255347    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255353    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255357    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255361    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255398    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255402    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255406    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255410    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255415    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:17:35.264491 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255422    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255427    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255432    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255441    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255446    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255450    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255454    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255459    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255464    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255469    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255473    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255478    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255482    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255486    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255490    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255494    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255503    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255507    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255511    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255516    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:17:35.264968 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255520    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255524    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255528    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255532    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255536    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255577    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255583    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255588    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255628    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255633    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255637    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255642    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255646    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255650    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255654    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255659    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255663    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255667    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255671    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255676    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:17:35.265456 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255684    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255708    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255742    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255751    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255775    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255911    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255924    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255930    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255934    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255938    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255943    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255947    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255955    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255962    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255968    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255973    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255977    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255982    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255986    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255991    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:17:35.265965 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.255996    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256001    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256005    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256010    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256014    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256018    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256024    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.256028    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.256812    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.264459    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.264475    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.265453    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.265461    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265536    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:17:35.266457 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265542    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265545    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265548    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265552    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265555    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265558    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265561    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265563    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265565    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265568    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265570    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265573    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265576    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265578    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265580    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265583    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265586    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265589    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265591    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265594    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:17:35.266813 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265596    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265599    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265601    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265604    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265606    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265608    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265610    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265614    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265617    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265619    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265622    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265624    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265626    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265629    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265631    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265634    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265636    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265639    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265641    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265643    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:17:35.267339 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265646    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265648    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265651    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265653    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265656    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265658    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265660    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265663    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265666    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265669    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265671    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265674    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265676    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265679    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265682    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265684    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265688    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265692    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265695    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265698    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:17:35.267817 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265701    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265704    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265707    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265710    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265713    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265715    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265718    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265720    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265723    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265727    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265730    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265733    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265735    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265738    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265741    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265743    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265746    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265748    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265751    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:17:35.268301 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265753    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265755    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265758    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265761    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265763    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265765    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265768    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265770    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265772    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265776    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265780    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265784    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265786    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265789    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265791    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265794    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265797    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265799    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:17:35.268761 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265802    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.265807    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265940    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265945    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265948    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265951    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265954    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265957    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265959    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265962    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265964    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265967    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265970    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265974    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265977    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 13:17:35.269211 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265981    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265983    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265986    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265989    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265992    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265994    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265996    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.265999    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266001    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266005    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266008    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266011    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266013    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266015    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266018    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266020    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266023    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266025    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266027    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 13:17:35.269579 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266030    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266032    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266034    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266037    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266039    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266042    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266044    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266047    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266049    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266051    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266053    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266057    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266059    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266062    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266065    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266067    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266070    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266072    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266074    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266077    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 13:17:35.270089 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266079    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266082    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266084    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266086    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266088    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266091    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266093    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266096    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266098    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266100    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266103    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266106    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266109    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266112    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266114    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266117    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266120    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266122    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266125    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 13:17:35.270572 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266128    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266131    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266133    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266136    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266138    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266141    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266144    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266146    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266149    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266152    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266154    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266156    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266159    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266162    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266164    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266167    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266169    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266171    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266174    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266176    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 13:17:35.271051 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266178    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266181    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266183    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266186    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266189    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266191    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266194    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:35.266196    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.266200    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.266314    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.269749    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.271236    2581 server.go:1019] "Starting client certificate rotation"
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.271351    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:17:35.271634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.271424    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 13:17:35.274882 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.274865    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:17:35.277878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.277862    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 13:17:35.287654 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.287637    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 23 13:17:35.290799 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.290780    2581 log.go:25] "Validated CRI v1 image API"
Jul 23 13:17:35.291633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.291614    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 13:17:35.294483 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.294463    2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c0261266-88d7-4512-9acc-d794efd322cb:/dev/nvme0n1p4 d8c36d2b-949c-4262-b3b7-fdfba8c0c0df:/dev/nvme0n1p3]
Jul 23 13:17:35.294528 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.294484    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 13:17:35.300551 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.300443    2581 manager.go:216] Machine: {Timestamp:2026-07-23 13:17:35.299115715 +0000 UTC m=+0.372230288 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3077271 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28cb29376dea343feaf29a3a9dff85 SystemUUID:ec28cb29-376d-ea34-3fea-f29a3a9dff85 BootID:f0d0cf43-e962-48de-922f-9587f2297c21 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:f9:d8:4c:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:f9:d8:4c:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:e6:01:83:e3:c8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 13:17:35.300551 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.300546    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 13:17:35.300679 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.300628    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 13:17:35.304648 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.304621    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 13:17:35.304786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.304651    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-235.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 13:17:35.305595 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.305585    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 13:17:35.305637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.305597    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 13:17:35.305637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.305606    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:17:35.305710 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.305695    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:17:35.306516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.306505    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 13:17:35.308237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.308226    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 13:17:35.311785 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311774    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:17:35.311923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311913    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 13:17:35.311964 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311944    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 13:17:35.311964 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311953    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 13:17:35.312020 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311967    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 13:17:35.312020 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311976    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 23 13:17:35.312020 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.311985    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 13:17:35.312439 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.312427    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:17:35.312482 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.312446    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 13:17:35.314930 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.314912    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 13:17:35.316648 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.316631    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 13:17:35.316710 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.316664    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 13:17:35.318152 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318138    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318158    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318164    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318170    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318184    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318189    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318197    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318202    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318208    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 13:17:35.318216 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318213    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 13:17:35.318455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318222    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 13:17:35.318455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.318228    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 13:17:35.320061 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.320049    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 13:17:35.320061 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.320059    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 13:17:35.323555 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.323531    2581 server.go:1268] "Started kubelet"
Jul 23 13:17:35.323655 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.323592    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 13:17:35.323779 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.323706    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 13:17:35.323906 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.323799    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 13:17:35.324519 ip-10-0-141-235 systemd[1]: Started Kubernetes Kubelet.
Jul 23 13:17:35.325367 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.325341    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-235.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 13:17:35.325367 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.325350    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 13:17:35.326067 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.326028    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 13:17:35.326133 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.326028    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 13:17:35.326830 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.326815    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 13:17:35.330571 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.330540    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 13:17:35.334072 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.332797    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-235.ec2.internal.18c4eda7572d86ae  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-235.ec2.internal,UID:ip-10-0-141-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-235.ec2.internal,},FirstTimestamp:2026-07-23 13:17:35.323481774 +0000 UTC m=+0.396596347,LastTimestamp:2026-07-23 13:17:35.323481774 +0000 UTC m=+0.396596347,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-235.ec2.internal,}"
Jul 23 13:17:35.334993 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.334969    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 13:17:35.335082 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.335055    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.335145 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.334973    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 13:17:35.336037 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.335851    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 13:17:35.336129 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.335880    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 13:17:35.336129 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.336094    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 13:17:35.337390 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.337371    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 13:17:35.337390 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.337388    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 13:17:35.337567 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.337551    2581 factory.go:55] Registering systemd factory
Jul 23 13:17:35.337642 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.337633    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 23 13:17:35.337967 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.337942    2581 factory.go:153] Registering CRI-O factory
Jul 23 13:17:35.337967 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.337959    2581 factory.go:223] Registration of the crio container factory successfully
Jul 23 13:17:35.338083 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.338037    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 13:17:35.338083 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.338066    2581 factory.go:103] Registering Raw factory
Jul 23 13:17:35.338083 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.338080    2581 manager.go:1196] Started watching for new ooms in manager
Jul 23 13:17:35.338553 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.338534    2581 manager.go:349] Starting recovery of all containers
Jul 23 13:17:35.340185 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.340152    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-235.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 13:17:35.340766 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.340743    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 13:17:35.349822 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.349810    2581 manager.go:354] Recovery completed
Jul 23 13:17:35.353826 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.353813    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.355767 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.355744    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.355862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.355781    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.355862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.355796    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.356348 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.356337    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.356385 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.356338    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 13:17:35.356419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.356388    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 13:17:35.356419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.356405    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 13:17:35.357085 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.357072    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.357120 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.357101    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.357120 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.357112    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.357725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.357715    2581 policy_none.go:49] "None policy: Start"
Jul 23 13:17:35.357767 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.357729    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 13:17:35.357767 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.357739    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 13:17:35.358129 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.358056    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-235.ec2.internal.18c4eda7591a2686  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-235.ec2.internal,UID:ip-10-0-141-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-235.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-235.ec2.internal,},FirstTimestamp:2026-07-23 13:17:35.355766406 +0000 UTC m=+0.428880989,LastTimestamp:2026-07-23 13:17:35.355766406 +0000 UTC m=+0.428880989,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-235.ec2.internal,}"
Jul 23 13:17:35.358925 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.358915    2581 policy_none.go:47] "Start"
Jul 23 13:17:35.363578 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.363561    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p5f8p"
Jul 23 13:17:35.368153 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.368095    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-235.ec2.internal.18c4eda7591a7a0a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-235.ec2.internal,UID:ip-10-0-141-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-235.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-235.ec2.internal,},FirstTimestamp:2026-07-23 13:17:35.355787786 +0000 UTC m=+0.428902361,LastTimestamp:2026-07-23 13:17:35.355787786 +0000 UTC m=+0.428902361,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-235.ec2.internal,}"
Jul 23 13:17:35.371594 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.371579    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-p5f8p"
Jul 23 13:17:35.376255 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.376192    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-235.ec2.internal.18c4eda7591ab16c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-235.ec2.internal,UID:ip-10-0-141-235.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-141-235.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-141-235.ec2.internal,},FirstTimestamp:2026-07-23 13:17:35.355801964 +0000 UTC m=+0.428916538,LastTimestamp:2026-07-23 13:17:35.355801964 +0000 UTC m=+0.428916538,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-235.ec2.internal,}"
Jul 23 13:17:35.397477 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397358    2581 manager.go:337] "Starting Device Plugin manager"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.397496    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397509    2581 server.go:87] "Starting device plugin registration server"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397699    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397708    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397826    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397933    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.397942    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.398368    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.398415    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.409671    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.410894    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.410926    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.410943    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 13:17:35.411895 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.410980    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 13:17:35.413415 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.413397    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:17:35.497971 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.497905    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.498710 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.498693    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.498794 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.498723    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.498794 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.498740    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.498794 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.498768    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.508444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.508428    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.508537 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.508452    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-235.ec2.internal\": node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.511382 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.511365    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"]
Jul 23 13:17:35.511444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.511431    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.512831 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.512816    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.512926 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.512854    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.512926 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.512869    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.514190 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.514178    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.514318 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.514293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.514356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.514334    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.514869 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.514856    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.514931 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.514882    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.514931 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.514894    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.516314 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.516296    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.516376 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.516326    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.516376 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.516336    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.517630 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.517613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.517703 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.517654    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:35.518280 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.518263    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:35.518363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.518292    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:35.518363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.518302    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:35.527546 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.527524    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.538099 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.538082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8980caa1f3b99b2fa8f73d24f06042d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"8980caa1f3b99b2fa8f73d24f06042d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.538158 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.538107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8980caa1f3b99b2fa8f73d24f06042d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"8980caa1f3b99b2fa8f73d24f06042d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.538158 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.538123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77cabb2dc4c03ac54c6bc0b67bc8bb5e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-235.ec2.internal\" (UID: \"77cabb2dc4c03ac54c6bc0b67bc8bb5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.548467 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.548449    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-235.ec2.internal\" not found" node="ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.552653 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.552637    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-235.ec2.internal\" not found" node="ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.628212 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.628192    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.638567 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.638550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77cabb2dc4c03ac54c6bc0b67bc8bb5e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-235.ec2.internal\" (UID: \"77cabb2dc4c03ac54c6bc0b67bc8bb5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.638626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.638572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8980caa1f3b99b2fa8f73d24f06042d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"8980caa1f3b99b2fa8f73d24f06042d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.638626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.638593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8980caa1f3b99b2fa8f73d24f06042d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"8980caa1f3b99b2fa8f73d24f06042d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.638686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.638635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8980caa1f3b99b2fa8f73d24f06042d8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"8980caa1f3b99b2fa8f73d24f06042d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.638686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.638665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/77cabb2dc4c03ac54c6bc0b67bc8bb5e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-235.ec2.internal\" (UID: \"77cabb2dc4c03ac54c6bc0b67bc8bb5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.638747 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.638665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8980caa1f3b99b2fa8f73d24f06042d8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal\" (UID: \"8980caa1f3b99b2fa8f73d24f06042d8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.728707 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.728685    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.829568 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.829493    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:35.850993 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.850977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.858098 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:35.858077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:35.929984 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:35.929956    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.030438 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.030414    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.130983 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.130936    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.231541 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.231522    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.271050 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.271033    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 13:17:36.271408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.271170    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 13:17:36.332224 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.332205    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.377335 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.377306    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 13:12:36 +0000 UTC" deadline="2028-01-09 01:51:31.524577372 +0000 UTC"
Jul 23 13:17:36.377335 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.377332    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12828h33m55.147248478s"
Jul 23 13:17:36.432593 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.432546    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.520087 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.520067    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 13:17:36.520985 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.520970    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 13:17:36.521048 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.521001    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 13:17:36.521048 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.521011    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeHasSufficientPID"
Jul 23 13:17:36.533144 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.533124    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.633959 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.633941    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.710385 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.710341    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:17:36.734949 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:36.734932    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-235.ec2.internal\" not found"
Jul 23 13:17:36.738304 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:36.738282    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cabb2dc4c03ac54c6bc0b67bc8bb5e.slice/crio-9396d27296b552a2f76f59574ab86a8c0b93825c5f9990b090dfda48a46971b2 WatchSource:0}: Error finding container 9396d27296b552a2f76f59574ab86a8c0b93825c5f9990b090dfda48a46971b2: Status 404 returned error can't find the container with id 9396d27296b552a2f76f59574ab86a8c0b93825c5f9990b090dfda48a46971b2
Jul 23 13:17:36.738801 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:36.738790    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8980caa1f3b99b2fa8f73d24f06042d8.slice/crio-55b0dbba224dd43a2e1474db14301d055a341798d12219b3f1601eea8b66aebd WatchSource:0}: Error finding container 55b0dbba224dd43a2e1474db14301d055a341798d12219b3f1601eea8b66aebd: Status 404 returned error can't find the container with id 55b0dbba224dd43a2e1474db14301d055a341798d12219b3f1601eea8b66aebd
Jul 23 13:17:36.744792 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.744779    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:17:36.791988 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.791968    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:17:36.835727 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.835706    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:36.849491 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.849472    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:17:36.850851 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.850827    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal"
Jul 23 13:17:36.861078 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.861060    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 13:17:36.889946 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:36.889927    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:17:38.713583 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.713508    2581 apiserver.go:52] "Watching apiserver"
Jul 23 13:17:38.723836 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.723808    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 13:17:38.724251 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.724229    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-hjt2v","kube-system/konnectivity-agent-vxb2v","openshift-dns/node-resolver-x8p5f","openshift-image-registry/node-ca-r7tsz","openshift-multus/multus-additional-cni-plugins-zd5lz","openshift-multus/network-metrics-daemon-ct4ws","openshift-network-diagnostics/network-check-target-d7j25","openshift-ovn-kubernetes/ovnkube-node-xxhgn","kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht","openshift-cluster-node-tuning-operator/tuned-b5mfl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal","openshift-multus/multus-x9t2s","openshift-network-operator/iptables-alerter-dlqsd"]
Jul 23 13:17:38.725783 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.725760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.727594 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.727574    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.728720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.729208    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.729252    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.729259    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.729213    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4xttt\""
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.729211    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.729481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.729391    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 13:17:38.730022 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.730003    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:38.730166 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.730068    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:38.730942 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.730684    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 13:17:38.730942 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.730733    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jnf9n\""
Jul 23 13:17:38.731305 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.731285    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.731808 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.731786    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.731904 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.731857    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sw8kx\""
Jul 23 13:17:38.732000 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.731959    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.732360 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.732340    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:38.732714 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.732673    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:38.734022 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.734000    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9qwct\""
Jul 23 13:17:38.734499 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.734480    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.734571 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.734534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.734652 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.734607    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:38.734740 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.734724    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 13:17:38.734803 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.734788    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.736940 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.736223    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 13:17:38.737055 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.737002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.738329 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.738308    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.740488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.739737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.740488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.740239    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 13:17:38.740488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.740278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 13:17:38.740870 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.740850    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.740956 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.740869    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 13:17:38.740956 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.740879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.740956 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.740891    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 13:17:38.741120 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.741012    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.741403 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.741387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.742627 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.742611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.742878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.742861    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cvnl4\""
Jul 23 13:17:38.742878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.742877    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wxps5\""
Jul 23 13:17:38.743102 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.743068    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 13:17:38.743196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.743183    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.743436 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.743421    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.743551 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.743536    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.743649 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.743636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7jpcf\""
Jul 23 13:17:38.744427 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.744394    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 13:17:38.744517 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.744450    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 13:17:38.744656 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.744642    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8zqc6\""
Jul 23 13:17:38.745801 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.745779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-64g2f\""
Jul 23 13:17:38.745998 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.745980    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:17:38.746329 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746080    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 13:17:38.746329 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.745989    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-systemd\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746376    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-conf-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84224f78-4b24-4f6f-be20-68683ff08899-etc-tuned\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746406    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb4ph\" (UniqueName: \"kubernetes.io/projected/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-kube-api-access-cb4ph\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746421    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-sys-fs\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746434    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cnibin\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-cni-netd\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746463    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-k8s-cni-cncf-io\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.746487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746485    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-multus-certs\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c202944-4918-447e-b505-4bb6ffb66ac6-kubelet-config\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-cni-bin\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-etc-kubernetes\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6hn\" (UniqueName: \"kubernetes.io/projected/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-kube-api-access-fc6hn\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-socket-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746726    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-device-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-os-release\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-lib-modules\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84224f78-4b24-4f6f-be20-68683ff08899-tmp\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746854    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-systemd-units\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-log-socket\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.746919 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-hostroot\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-kubernetes\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.746971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-cni-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-netns\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747045    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-run\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-var-lib-kubelet\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747149    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-host\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-etc-selinux\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747183    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-slash\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-etc-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-ovn\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747256    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-env-overrides\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747278    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysctl-d\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.747693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-cni-binary-copy\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747337    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-daemon-config\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747356    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d7dz\" (UniqueName: \"kubernetes.io/projected/84224f78-4b24-4f6f-be20-68683ff08899-kube-api-access-2d7dz\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-os-release\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-var-lib-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-system-cni-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-sys\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-node-log\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x28jf\" (UniqueName: \"kubernetes.io/projected/8ee508a2-24ba-4f8e-9680-07e0fac3e276-kube-api-access-x28jf\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-cni-multus\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysctl-conf\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-serviceca\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-registration-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovn-node-metrics-cert\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.748610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgrh9\" (UniqueName: \"kubernetes.io/projected/86371a3a-c576-448a-8c28-3d148149da2f-kube-api-access-bgrh9\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747698    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-run-netns\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovnkube-script-lib\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747727    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-modprobe-d\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-kubelet\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747754    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-socket-dir-parent\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-cni-bin\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-cnibin\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-host\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747831    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6b7z\" (UniqueName: \"kubernetes.io/projected/b242dcc4-2e41-4df4-b4b6-984c2974bc57-kube-api-access-z6b7z\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-system-cni-dir\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-kubelet\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysconfig\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxjjb\" (UniqueName: \"kubernetes.io/projected/3db35aac-fa59-4811-ac8b-3ad5d14733c5-kube-api-access-jxjjb\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.747986    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c202944-4918-447e-b505-4bb6ffb66ac6-dbus\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.749274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.748021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-systemd\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.749827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.748047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovnkube-config\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.749827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.748076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:38.749827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.748122    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.749827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.748625    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 13:17:38.767426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.767405    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxb49"
Jul 23 13:17:38.773504 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.773485    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxb49"
Jul 23 13:17:38.816461 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.816403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal" event={"ID":"77cabb2dc4c03ac54c6bc0b67bc8bb5e","Type":"ContainerStarted","Data":"9396d27296b552a2f76f59574ab86a8c0b93825c5f9990b090dfda48a46971b2"}
Jul 23 13:17:38.817703 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.817679    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" event={"ID":"8980caa1f3b99b2fa8f73d24f06042d8","Type":"ContainerStarted","Data":"55b0dbba224dd43a2e1474db14301d055a341798d12219b3f1601eea8b66aebd"}
Jul 23 13:17:38.837388 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.837366    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 13:17:38.848515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-run\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848522    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-var-lib-kubelet\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848542    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0a03f86-7ad0-4bdf-843e-e450f1580dac-agent-certs\") pod \"konnectivity-agent-vxb2v\" (UID: \"c0a03f86-7ad0-4bdf-843e-e450f1580dac\") " pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snhn\" (UniqueName: \"kubernetes.io/projected/9b2c5dad-289b-4a6b-a640-c27a4b195c72-kube-api-access-6snhn\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-host\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.848637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848632    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-etc-selinux\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-slash\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-etc-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848705    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-ovn\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-env-overrides\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848749    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8baab27e-7c43-4f63-9b8a-b289a0727d62-hosts-file\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysctl-d\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-cni-binary-copy\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-daemon-config\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d7dz\" (UniqueName: \"kubernetes.io/projected/84224f78-4b24-4f6f-be20-68683ff08899-kube-api-access-2d7dz\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-os-release\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-var-lib-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848939    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-system-cni-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-sys\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.848981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.849029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-node-log\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x28jf\" (UniqueName: \"kubernetes.io/projected/8ee508a2-24ba-4f8e-9680-07e0fac3e276-kube-api-access-x28jf\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-cni-multus\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysctl-conf\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849125    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-serviceca\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849150    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-registration-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovn-node-metrics-cert\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b2c5dad-289b-4a6b-a640-c27a4b195c72-host-slash\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgrh9\" (UniqueName: \"kubernetes.io/projected/86371a3a-c576-448a-8c28-3d148149da2f-kube-api-access-bgrh9\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849241    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-run\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-run-netns\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovnkube-script-lib\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-run-netns\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-modprobe-d\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-kubelet\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849341    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-socket-dir-parent\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-cni-bin\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.849644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-cnibin\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-host\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6b7z\" (UniqueName: \"kubernetes.io/projected/b242dcc4-2e41-4df4-b4b6-984c2974bc57-kube-api-access-z6b7z\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysctl-d\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-system-cni-dir\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-kubelet\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysconfig\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxjjb\" (UniqueName: \"kubernetes.io/projected/3db35aac-fa59-4811-ac8b-3ad5d14733c5-kube-api-access-jxjjb\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c202944-4918-447e-b505-4bb6ffb66ac6-dbus\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-systemd\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovnkube-config\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b2c5dad-289b-4a6b-a640-c27a4b195c72-iptables-alerter-script\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-systemd\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-conf-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.850469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84224f78-4b24-4f6f-be20-68683ff08899-etc-tuned\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb4ph\" (UniqueName: \"kubernetes.io/projected/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-kube-api-access-cb4ph\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-sys-fs\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cnibin\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-cni-netd\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-k8s-cni-cncf-io\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-multus-certs\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849808    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c202944-4918-447e-b505-4bb6ffb66ac6-kubelet-config\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849823    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0a03f86-7ad0-4bdf-843e-e450f1580dac-konnectivity-ca\") pod \"konnectivity-agent-vxb2v\" (UID: \"c0a03f86-7ad0-4bdf-843e-e450f1580dac\") " pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-cni-bin\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-etc-kubernetes\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6hn\" (UniqueName: \"kubernetes.io/projected/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-kube-api-access-fc6hn\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849918    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-cni-binary-copy\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-socket-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-device-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.851155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849973    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.849988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8baab27e-7c43-4f63-9b8a-b289a0727d62-tmp-dir\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-os-release\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-lib-modules\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84224f78-4b24-4f6f-be20-68683ff08899-tmp\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-systemd-units\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-log-socket\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-hostroot\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850131    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-kubernetes\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtxdg\" (UniqueName: \"kubernetes.io/projected/8baab27e-7c43-4f63-9b8a-b289a0727d62-kube-api-access-dtxdg\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-cni-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-netns\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850250    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-netns\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-var-lib-kubelet\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-daemon-config\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-os-release\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850640    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-var-lib-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850674    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852042 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-system-cni-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-sys\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850763    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.850764    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850811    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-host\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.850827    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:17:39.350797037 +0000 UTC m=+3.023662486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-node-log\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-etc-selinux\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.850968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851003    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-cni-multus\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-slash\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-etc-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851070    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-ovn\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851114    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysctl-conf\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851400    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-env-overrides\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-serviceca\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.852928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-registration-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovnkube-script-lib\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-modprobe-d\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851860    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-cni-netd\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851877    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cnibin\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7c202944-4918-447e-b505-4bb6ffb66ac6-kubelet-config\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-multus-certs\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851972    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-kubelet\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.851986    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-openvswitch\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852025    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-var-lib-cni-bin\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852030    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-cnibin\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852124    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-device-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-socket-dir\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-cni-bin\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852268    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-etc-kubernetes\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852509    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-host\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.853821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852611    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-os-release\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3db35aac-fa59-4811-ac8b-3ad5d14733c5-system-cni-dir\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-lib-modules\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-host-kubelet\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-sysconfig\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.852803    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.852845    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:39.352832727 +0000 UTC m=+3.025698149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.852996    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-conf-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.853007    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-systemd\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.853138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7c202944-4918-447e-b505-4bb6ffb66ac6-dbus\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.853178    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-run-systemd\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.853554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovnkube-config\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.854670 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.854396    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3db35aac-fa59-4811-ac8b-3ad5d14733c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.854907    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84224f78-4b24-4f6f-be20-68683ff08899-etc-kubernetes\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.854919    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-systemd-units\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.854911    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8ee508a2-24ba-4f8e-9680-07e0fac3e276-log-socket\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.854950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-hostroot\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.854968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-cni-dir\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.855010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-multus-socket-dir-parent\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.855013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-host-run-k8s-cni-cncf-io\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.855753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.855074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b242dcc4-2e41-4df4-b4b6-984c2974bc57-sys-fs\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.856707 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.856655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/84224f78-4b24-4f6f-be20-68683ff08899-etc-tuned\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.856869 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.856734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8ee508a2-24ba-4f8e-9680-07e0fac3e276-ovn-node-metrics-cert\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.857926 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.857905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/84224f78-4b24-4f6f-be20-68683ff08899-tmp\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.859681 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.859632    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x28jf\" (UniqueName: \"kubernetes.io/projected/8ee508a2-24ba-4f8e-9680-07e0fac3e276-kube-api-access-x28jf\") pod \"ovnkube-node-xxhgn\" (UID: \"8ee508a2-24ba-4f8e-9680-07e0fac3e276\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:38.860187 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.860163    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d7dz\" (UniqueName: \"kubernetes.io/projected/84224f78-4b24-4f6f-be20-68683ff08899-kube-api-access-2d7dz\") pod \"tuned-b5mfl\" (UID: \"84224f78-4b24-4f6f-be20-68683ff08899\") " pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:38.860364 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.860341    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:17:38.860364 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.860367    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:17:38.860479 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.860380    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:38.860479 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:38.860431    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:39.360415251 +0000 UTC m=+3.033280690 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:38.861046 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.860988    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6hn\" (UniqueName: \"kubernetes.io/projected/a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74-kube-api-access-fc6hn\") pod \"multus-x9t2s\" (UID: \"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74\") " pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:38.862221 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.862194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxjjb\" (UniqueName: \"kubernetes.io/projected/3db35aac-fa59-4811-ac8b-3ad5d14733c5-kube-api-access-jxjjb\") pod \"multus-additional-cni-plugins-zd5lz\" (UID: \"3db35aac-fa59-4811-ac8b-3ad5d14733c5\") " pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:38.862852 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.862823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6b7z\" (UniqueName: \"kubernetes.io/projected/b242dcc4-2e41-4df4-b4b6-984c2974bc57-kube-api-access-z6b7z\") pod \"aws-ebs-csi-driver-node-fclht\" (UID: \"b242dcc4-2e41-4df4-b4b6-984c2974bc57\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:38.863430 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.863399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgrh9\" (UniqueName: \"kubernetes.io/projected/86371a3a-c576-448a-8c28-3d148149da2f-kube-api-access-bgrh9\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:38.864205 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.864166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb4ph\" (UniqueName: \"kubernetes.io/projected/27b8ae6a-bf71-44c1-a92c-e7ddc36d0496-kube-api-access-cb4ph\") pod \"node-ca-r7tsz\" (UID: \"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496\") " pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8baab27e-7c43-4f63-9b8a-b289a0727d62-hosts-file\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b2c5dad-289b-4a6b-a640-c27a4b195c72-host-slash\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950768    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b2c5dad-289b-4a6b-a640-c27a4b195c72-iptables-alerter-script\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0a03f86-7ad0-4bdf-843e-e450f1580dac-konnectivity-ca\") pod \"konnectivity-agent-vxb2v\" (UID: \"c0a03f86-7ad0-4bdf-843e-e450f1580dac\") " pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950832    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8baab27e-7c43-4f63-9b8a-b289a0727d62-tmp-dir\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950857    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtxdg\" (UniqueName: \"kubernetes.io/projected/8baab27e-7c43-4f63-9b8a-b289a0727d62-kube-api-access-dtxdg\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0a03f86-7ad0-4bdf-843e-e450f1580dac-agent-certs\") pod \"konnectivity-agent-vxb2v\" (UID: \"c0a03f86-7ad0-4bdf-843e-e450f1580dac\") " pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.950915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6snhn\" (UniqueName: \"kubernetes.io/projected/9b2c5dad-289b-4a6b-a640-c27a4b195c72-kube-api-access-6snhn\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.951166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8baab27e-7c43-4f63-9b8a-b289a0727d62-hosts-file\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.951215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9b2c5dad-289b-4a6b-a640-c27a4b195c72-host-slash\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.951694    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9b2c5dad-289b-4a6b-a640-c27a4b195c72-iptables-alerter-script\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.952108    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c0a03f86-7ad0-4bdf-843e-e450f1580dac-konnectivity-ca\") pod \"konnectivity-agent-vxb2v\" (UID: \"c0a03f86-7ad0-4bdf-843e-e450f1580dac\") " pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.952871 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.952364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8baab27e-7c43-4f63-9b8a-b289a0727d62-tmp-dir\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.956252 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.956209    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c0a03f86-7ad0-4bdf-843e-e450f1580dac-agent-certs\") pod \"konnectivity-agent-vxb2v\" (UID: \"c0a03f86-7ad0-4bdf-843e-e450f1580dac\") " pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:38.959241 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.959217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snhn\" (UniqueName: \"kubernetes.io/projected/9b2c5dad-289b-4a6b-a640-c27a4b195c72-kube-api-access-6snhn\") pod \"iptables-alerter-dlqsd\" (UID: \"9b2c5dad-289b-4a6b-a640-c27a4b195c72\") " pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:38.963250 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.963229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtxdg\" (UniqueName: \"kubernetes.io/projected/8baab27e-7c43-4f63-9b8a-b289a0727d62-kube-api-access-dtxdg\") pod \"node-resolver-x8p5f\" (UID: \"8baab27e-7c43-4f63-9b8a-b289a0727d62\") " pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:38.969381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:38.969331    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 13:17:39.039399 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.039376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zd5lz"
Jul 23 13:17:39.045825 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.045806    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-x9t2s"
Jul 23 13:17:39.050578 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.050552    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db35aac_fa59_4811_ac8b_3ad5d14733c5.slice/crio-75aad4f8ddf7df23086b2102266609ce720b13b626e6bf022d105ea802ab654e WatchSource:0}: Error finding container 75aad4f8ddf7df23086b2102266609ce720b13b626e6bf022d105ea802ab654e: Status 404 returned error can't find the container with id 75aad4f8ddf7df23086b2102266609ce720b13b626e6bf022d105ea802ab654e
Jul 23 13:17:39.056335 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.056316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:17:39.056530 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.056511    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda66dc7c8_4b8c_4cff_8c7a_8c0472d91e74.slice/crio-7b8c8478f66830cb8953eff134ff9e72c7ac53f39440eaf24532383d7f23a543 WatchSource:0}: Error finding container 7b8c8478f66830cb8953eff134ff9e72c7ac53f39440eaf24532383d7f23a543: Status 404 returned error can't find the container with id 7b8c8478f66830cb8953eff134ff9e72c7ac53f39440eaf24532383d7f23a543
Jul 23 13:17:39.062507 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.062488    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-b5mfl"
Jul 23 13:17:39.068778 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.068757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r7tsz"
Jul 23 13:17:39.076917 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.076892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht"
Jul 23 13:17:39.083618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.083600    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x8p5f"
Jul 23 13:17:39.091681 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.091663    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:17:39.096157 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.096140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dlqsd"
Jul 23 13:17:39.352668 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.352586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:39.352831 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.352744    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:39.352831 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.352813    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:17:40.352790427 +0000 UTC m=+4.025655854 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:39.384104 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.384061    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee508a2_24ba_4f8e_9680_07e0fac3e276.slice/crio-73bbcafa74ffeb8524caa57c4ecc1cf574e2cc4ae96b67651261618a04828cfd WatchSource:0}: Error finding container 73bbcafa74ffeb8524caa57c4ecc1cf574e2cc4ae96b67651261618a04828cfd: Status 404 returned error can't find the container with id 73bbcafa74ffeb8524caa57c4ecc1cf574e2cc4ae96b67651261618a04828cfd
Jul 23 13:17:39.453722 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.453685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:39.453858 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.453735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:39.453858 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.453822    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:39.453969 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.453857    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:17:39.453969 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.453877    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:17:39.453969 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.453890    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:39.453969 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.453891    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:40.453871183 +0000 UTC m=+4.126736618 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:39.453969 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.453943    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:40.453928812 +0000 UTC m=+4.126794235 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:39.725168 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.725134    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb242dcc4_2e41_4df4_b4b6_984c2974bc57.slice/crio-4bdfbe09d198d18ca0289a828885588213601f4255d04d2bfe71d5c38edde3bc WatchSource:0}: Error finding container 4bdfbe09d198d18ca0289a828885588213601f4255d04d2bfe71d5c38edde3bc: Status 404 returned error can't find the container with id 4bdfbe09d198d18ca0289a828885588213601f4255d04d2bfe71d5c38edde3bc
Jul 23 13:17:39.728634 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.728609    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a03f86_7ad0_4bdf_843e_e450f1580dac.slice/crio-b30e14ccc6886556fa7c0b17fe9686bb6dab5236048d207b3bc9cd55d07e2ee2 WatchSource:0}: Error finding container b30e14ccc6886556fa7c0b17fe9686bb6dab5236048d207b3bc9cd55d07e2ee2: Status 404 returned error can't find the container with id b30e14ccc6886556fa7c0b17fe9686bb6dab5236048d207b3bc9cd55d07e2ee2
Jul 23 13:17:39.729343 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.729319    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8baab27e_7c43_4f63_9b8a_b289a0727d62.slice/crio-95f730cb0107bda51adc64282acfc1d545c3572d5d227ade5617060230bab75a WatchSource:0}: Error finding container 95f730cb0107bda51adc64282acfc1d545c3572d5d227ade5617060230bab75a: Status 404 returned error can't find the container with id 95f730cb0107bda51adc64282acfc1d545c3572d5d227ade5617060230bab75a
Jul 23 13:17:39.729828 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.729805    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84224f78_4b24_4f6f_be20_68683ff08899.slice/crio-b518b0edf48b44960cbec427ca8c282ce18e96d4bdbb1bbea1a0fac9503282df WatchSource:0}: Error finding container b518b0edf48b44960cbec427ca8c282ce18e96d4bdbb1bbea1a0fac9503282df: Status 404 returned error can't find the container with id b518b0edf48b44960cbec427ca8c282ce18e96d4bdbb1bbea1a0fac9503282df
Jul 23 13:17:39.731674 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.731396    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b2c5dad_289b_4a6b_a640_c27a4b195c72.slice/crio-e7e6fdd6342c96782be6975eabb69dc7ccc9dd13213f19f5098b5ad5e8ae31fb WatchSource:0}: Error finding container e7e6fdd6342c96782be6975eabb69dc7ccc9dd13213f19f5098b5ad5e8ae31fb: Status 404 returned error can't find the container with id e7e6fdd6342c96782be6975eabb69dc7ccc9dd13213f19f5098b5ad5e8ae31fb
Jul 23 13:17:39.732034 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:17:39.731989    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b8ae6a_bf71_44c1_a92c_e7ddc36d0496.slice/crio-05d7343290f691dce1243e40d61cb060b5c07965ee737eaddfd366ef3a3b29d4 WatchSource:0}: Error finding container 05d7343290f691dce1243e40d61cb060b5c07965ee737eaddfd366ef3a3b29d4: Status 404 returned error can't find the container with id 05d7343290f691dce1243e40d61cb060b5c07965ee737eaddfd366ef3a3b29d4
Jul 23 13:17:39.775877 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.775834    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:12:38 +0000 UTC" deadline="2028-05-03 14:30:44.68907109 +0000 UTC"
Jul 23 13:17:39.775877 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.775872    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15601h13m4.91320189s"
Jul 23 13:17:39.812263 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.812241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:39.812364 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:39.812347    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:39.820265 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.820240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r7tsz" event={"ID":"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496","Type":"ContainerStarted","Data":"05d7343290f691dce1243e40d61cb060b5c07965ee737eaddfd366ef3a3b29d4"}
Jul 23 13:17:39.821432 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.821407    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x8p5f" event={"ID":"8baab27e-7c43-4f63-9b8a-b289a0727d62","Type":"ContainerStarted","Data":"95f730cb0107bda51adc64282acfc1d545c3572d5d227ade5617060230bab75a"}
Jul 23 13:17:39.822557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.822532    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerStarted","Data":"75aad4f8ddf7df23086b2102266609ce720b13b626e6bf022d105ea802ab654e"}
Jul 23 13:17:39.823558 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.823537    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dlqsd" event={"ID":"9b2c5dad-289b-4a6b-a640-c27a4b195c72","Type":"ContainerStarted","Data":"e7e6fdd6342c96782be6975eabb69dc7ccc9dd13213f19f5098b5ad5e8ae31fb"}
Jul 23 13:17:39.824678 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.824655    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5mfl" event={"ID":"84224f78-4b24-4f6f-be20-68683ff08899","Type":"ContainerStarted","Data":"b518b0edf48b44960cbec427ca8c282ce18e96d4bdbb1bbea1a0fac9503282df"}
Jul 23 13:17:39.825736 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.825714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxb2v" event={"ID":"c0a03f86-7ad0-4bdf-843e-e450f1580dac","Type":"ContainerStarted","Data":"b30e14ccc6886556fa7c0b17fe9686bb6dab5236048d207b3bc9cd55d07e2ee2"}
Jul 23 13:17:39.826785 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.826763    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht" event={"ID":"b242dcc4-2e41-4df4-b4b6-984c2974bc57","Type":"ContainerStarted","Data":"4bdfbe09d198d18ca0289a828885588213601f4255d04d2bfe71d5c38edde3bc"}
Jul 23 13:17:39.827817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.827795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"73bbcafa74ffeb8524caa57c4ecc1cf574e2cc4ae96b67651261618a04828cfd"}
Jul 23 13:17:39.828857 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:39.828840    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x9t2s" event={"ID":"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74","Type":"ContainerStarted","Data":"7b8c8478f66830cb8953eff134ff9e72c7ac53f39440eaf24532383d7f23a543"}
Jul 23 13:17:40.360309 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.359615    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:40.360309 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.359769    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:40.360309 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.359961    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:17:42.35994349 +0000 UTC m=+6.032808915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:40.461019 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.460977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:40.461200 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.461029    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:40.461266 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.461216    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:17:40.461266 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.461234    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:17:40.461266 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.461246    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:40.461411 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.461306    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:42.461286072 +0000 UTC m=+6.134151494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:40.461695 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.461679    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:40.461746 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.461735    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:42.461719513 +0000 UTC m=+6.134584946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:40.776999 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.776963    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 13:12:38 +0000 UTC" deadline="2028-03-31 05:01:55.207689878 +0000 UTC"
Jul 23 13:17:40.776999 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.776995    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14799h44m14.430697423s"
Jul 23 13:17:40.814403 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.814354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:40.814543 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.814476    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:40.814886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.814864    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:40.814978 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:40.814958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:40.850103 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.850057    2581 generic.go:356] "Generic (PLEG): container finished" podID="8980caa1f3b99b2fa8f73d24f06042d8" containerID="0d9dd44de4ab4f7fd0ac52096c5bcd0c7e288d6dc0ea009d7ac83a81a6445b9f" exitCode=0
Jul 23 13:17:40.850219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:40.850120    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" event={"ID":"8980caa1f3b99b2fa8f73d24f06042d8","Type":"ContainerDied","Data":"0d9dd44de4ab4f7fd0ac52096c5bcd0c7e288d6dc0ea009d7ac83a81a6445b9f"}
Jul 23 13:17:41.812169 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:41.812140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:41.812610 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:41.812275    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:41.872140 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:41.872102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" event={"ID":"8980caa1f3b99b2fa8f73d24f06042d8","Type":"ContainerStarted","Data":"87bb4de04fd55a95d981662c22e5d2c97cc960abac3ec685f38c63f09c97b8ce"}
Jul 23 13:17:42.378281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:42.378220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:42.378442 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.378360    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:42.378442 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.378419    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:17:46.378400754 +0000 UTC m=+10.051266177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:42.479318 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:42.479284    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:42.479467 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:42.479334    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:42.479544 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.479508    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:17:42.479544 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.479528    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:17:42.479544 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.479541    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:42.479639 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.479592    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:46.479573913 +0000 UTC m=+10.152439340 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:42.479979 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.479962    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:42.480044 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.480012    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:46.479997701 +0000 UTC m=+10.152863127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:42.815137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:42.814446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:42.815137 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.814570    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:42.815137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:42.814939    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:42.815137 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:42.815024    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:43.811363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:43.811320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:43.811528 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:43.811422    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:44.812342 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:44.812312    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:44.812722 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:44.812442    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:44.812886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:44.812869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:44.812971 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:44.812953    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:45.811653 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:45.811569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:45.811813 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:45.811723    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:46.410893 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:46.410391    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:46.410893 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.410544    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:46.410893 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.410602    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:17:54.410585898 +0000 UTC m=+18.083451325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:46.511543 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:46.511508    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:46.511702 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:46.511561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:46.511702 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.511671    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:46.511702 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.511698    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:17:46.511884 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.511714    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:17:46.511884 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.511724    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:46.511884 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.511732    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:54.511718162 +0000 UTC m=+18.184583580 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:46.511884 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.511766    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:17:54.511751316 +0000 UTC m=+18.184616735 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:46.813833 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:46.813762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:46.813976 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.813912    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:46.815077 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:46.815046    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:46.815295 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:46.815268    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:47.811795 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:47.811762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:47.812297 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:47.811903    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:48.812121 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:48.811935    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:48.812121 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:48.812056    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:48.812121 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:48.812111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:48.812664 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:48.812198    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:49.811690 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:49.811659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:49.811826 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:49.811773    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:50.812332 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:50.812304    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:50.812793 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:50.812420    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:50.812905 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:50.812884    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:50.813009 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:50.812990    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:51.811592 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:51.811557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:51.811797 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:51.811695    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:52.813784 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:52.813752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:52.814248 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:52.813872    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:52.814297 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:52.814281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:52.814368 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:52.814349    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:53.812264 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:53.812229    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:53.812443 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:53.812368    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:54.477011 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:54.476977    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:54.477414 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.477145    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:54.477414 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.477209    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:10.477190581 +0000 UTC m=+34.150056001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:17:54.578305 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:54.578278    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:54.578436 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:54.578311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:54.578436 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.578433    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:17:54.578560 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.578442    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:54.578560 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.578518    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:10.578496872 +0000 UTC m=+34.251362303 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:17:54.578560 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.578448    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:17:54.578560 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.578542    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:54.578696 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.578580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:10.578569625 +0000 UTC m=+34.251435044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:17:54.811702 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:54.811641    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:54.811817 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.811735    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:54.811817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:54.811807    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:54.811919 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:54.811889    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:55.811929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:55.811895    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:55.812392 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:55.812009    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:56.813378 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:56.813345    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:56.813822 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:56.813458    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:56.813822 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:56.813514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:56.813822 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:56.813631    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:57.811866 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:57.811838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:57.812027 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:57.811950    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:58.811393 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:58.811355    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:17:58.811894 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:58.811406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:17:58.811894 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:58.811500    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:17:58.811894 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:58.811627    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:17:59.812536 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.812253    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:17:59.813117 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:17:59.812618    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:17:59.908993 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.908961    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-x9t2s" event={"ID":"a66dc7c8-4b8c-4cff-8c7a-8c0472d91e74","Type":"ContainerStarted","Data":"fb739f0ff0cff35fdec9a565e1ccfe99ec25b81a052049bf25e31bebc0245638"}
Jul 23 13:17:59.910476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.910452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal" event={"ID":"77cabb2dc4c03ac54c6bc0b67bc8bb5e","Type":"ContainerStarted","Data":"19efb404d10e5bcd9472489de1666fca9905a4494183ee8c65757da3bca1af47"}
Jul 23 13:17:59.911693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.911671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r7tsz" event={"ID":"27b8ae6a-bf71-44c1-a92c-e7ddc36d0496","Type":"ContainerStarted","Data":"4ac6e225001060f3fee6601977d2738a80a42908cadc83d24504e28eecb2057e"}
Jul 23 13:17:59.912987 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.912969    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x8p5f" event={"ID":"8baab27e-7c43-4f63-9b8a-b289a0727d62","Type":"ContainerStarted","Data":"d751bbcd3fd435cc7283b2ca22e1e78ecd867f8e464132881a2ff0869e33f3f9"}
Jul 23 13:17:59.914470 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.914451    2581 generic.go:356] "Generic (PLEG): container finished" podID="3db35aac-fa59-4811-ac8b-3ad5d14733c5" containerID="0a36124dd57f4550942d942cd46f98a9faa84e71ebe3e2d9a827fde6d5c557f3" exitCode=0
Jul 23 13:17:59.914558 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.914511    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerDied","Data":"0a36124dd57f4550942d942cd46f98a9faa84e71ebe3e2d9a827fde6d5c557f3"}
Jul 23 13:17:59.916030 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.916007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-b5mfl" event={"ID":"84224f78-4b24-4f6f-be20-68683ff08899","Type":"ContainerStarted","Data":"1f4587bab18bf9a70cc47390d12396361c2fa5af71d8a6568b302aa2987f8aca"}
Jul 23 13:17:59.917509 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.917486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxb2v" event={"ID":"c0a03f86-7ad0-4bdf-843e-e450f1580dac","Type":"ContainerStarted","Data":"0e329eba402ae7f3ca649aa86c48b088b1b3c8fcd007ec22f013325571efd502"}
Jul 23 13:17:59.918817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.918797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht" event={"ID":"b242dcc4-2e41-4df4-b4b6-984c2974bc57","Type":"ContainerStarted","Data":"f7f1fbbd9002251f5d0e8fe872f7938560d442d91252845ebe8a45c350f89cb9"}
Jul 23 13:17:59.921865 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.921848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"58c313b1fc230a60cb7404575b5331749ed9cb7dae76f8f55703f7ccc941e9d5"}
Jul 23 13:17:59.921964 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.921912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"c4c941025160f7e834eb30c079f61f5aa9013df4c297157668d552bbb090eefe"}
Jul 23 13:17:59.922026 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.921964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"3f085b74a6af2bccd4842f43bd49f2a2e29858c2051f3a7585df753cfe89d889"}
Jul 23 13:17:59.922026 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.922013    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"a0a445e18096b9bff990e0f7fd17c47883e77cfb3c24a8eaf29de03d541b2cfc"}
Jul 23 13:17:59.922151 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.922061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"17d7bd896a661ad378729d06b5096396acb6f32722efe3647c7855419cd64367"}
Jul 23 13:17:59.922151 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.922135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"08f8a1186202eb737fa3c1e4319c948438235264a1f278a2953780a66382db99"}
Jul 23 13:17:59.930821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.930785    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-235.ec2.internal" podStartSLOduration=21.930755367 podStartE2EDuration="21.930755367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:41.89544321 +0000 UTC m=+5.568308651" watchObservedRunningTime="2026-07-23 13:17:59.930755367 +0000 UTC m=+23.603620807"
Jul 23 13:17:59.930898 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.930854    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-x9t2s" podStartSLOduration=3.956331524 podStartE2EDuration="23.930850226s" totalImagesPullingTime="19.974518702s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:59.930170773 +0000 UTC m=+23.603036214" watchObservedRunningTime="2026-07-23 13:17:59.930850226 +0000 UTC m=+23.603715770"
Jul 23 13:17:59.968572 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.968507    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x8p5f" podStartSLOduration=3.668945124 podStartE2EDuration="22.968495968s" totalImagesPullingTime="19.299550844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:59.949389715 +0000 UTC m=+23.622255155" watchObservedRunningTime="2026-07-23 13:17:59.968495968 +0000 UTC m=+23.641361409"
Jul 23 13:17:59.994217 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.994187    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-b5mfl" podStartSLOduration=4.693449959 podStartE2EDuration="23.994177456s" totalImagesPullingTime="19.300727497s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:59.99388603 +0000 UTC m=+23.666751470" watchObservedRunningTime="2026-07-23 13:17:59.994177456 +0000 UTC m=+23.667042895"
Jul 23 13:17:59.994439 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:17:59.994420    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vxb2v" podStartSLOduration=9.054000328 podStartE2EDuration="22.994412661s" totalImagesPullingTime="13.940412333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:17:59.968648078 +0000 UTC m=+23.641513510" watchObservedRunningTime="2026-07-23 13:17:59.994412661 +0000 UTC m=+23.667278102"
Jul 23 13:18:00.010874 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:00.010844    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r7tsz" podStartSLOduration=3.710447209 podStartE2EDuration="23.010834433s" totalImagesPullingTime="19.300387224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:00.010418325 +0000 UTC m=+23.683283765" watchObservedRunningTime="2026-07-23 13:18:00.010834433 +0000 UTC m=+23.683699877"
Jul 23 13:18:00.079278 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:00.079234    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-235.ec2.internal" podStartSLOduration=22.079217781 podStartE2EDuration="22.079217781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:00.034042191 +0000 UTC m=+23.706907632" watchObservedRunningTime="2026-07-23 13:18:00.079217781 +0000 UTC m=+23.752083222"
Jul 23 13:18:00.811989 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:00.811954    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:00.812181 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:00.812072    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:00.812181 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:00.812133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:00.812299 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:00.812247    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:00.925788 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:00.925753    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dlqsd" event={"ID":"9b2c5dad-289b-4a6b-a640-c27a4b195c72","Type":"ContainerStarted","Data":"7854c4a61e51cbae4bc055d20a50bb456b360d36568171e7f60fae9ca2226065"}
Jul 23 13:18:00.943583 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:00.943540    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dlqsd" podStartSLOduration=4.642109869 podStartE2EDuration="23.943523825s" totalImagesPullingTime="19.301413956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:00.942907564 +0000 UTC m=+24.615773005" watchObservedRunningTime="2026-07-23 13:18:00.943523825 +0000 UTC m=+24.616389266"
Jul 23 13:18:01.811556 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:01.811525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:01.811719 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:01.811634    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:18:01.931721 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:01.931695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"98b653c8fccb2838a0262ee5c7414af891982d675f176127e5423ae35bebf04f"}
Jul 23 13:18:02.071226 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.070887    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 13:18:02.811035 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.810740    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T13:18:02.070907227Z","UUID":"4fa75fe3-e03b-492e-93bb-47acca5ba698","Handler":null,"Name":"","Endpoint":""}
Jul 23 13:18:02.811741 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.811716    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:02.811896 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:02.811836    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:02.811896 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.811882    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:02.812003 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:02.811968    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:02.814685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.814665    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 13:18:02.814685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.814691    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 13:18:02.936278 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:02.936237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht" event={"ID":"b242dcc4-2e41-4df4-b4b6-984c2974bc57","Type":"ContainerStarted","Data":"9e8faac41161cdf38977e926e51896ecb2bccb8c3aa7e1880610d841adc3e7ae"}
Jul 23 13:18:03.811560 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:03.811535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:03.811704 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:03.811660    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:18:04.713912 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:04.713875    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:18:04.714471 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:04.714408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:18:04.811723 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:04.811698    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:04.811885 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:04.811741    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:04.811885 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:04.811823    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:04.811989 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:04.811937    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:05.811775 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.811611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:05.812398 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:05.811855    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:18:05.946773 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.946716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht" event={"ID":"b242dcc4-2e41-4df4-b4b6-984c2974bc57","Type":"ContainerStarted","Data":"9296e2e8a4ab96b004c7add974b1805065a9f3b179c820d2c256a025b7d54579"}
Jul 23 13:18:05.950428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.950397    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" event={"ID":"8ee508a2-24ba-4f8e-9680-07e0fac3e276","Type":"ContainerStarted","Data":"e7b424d320b490ee2d7bad8f2c167ccb900f68a9213db6881454191aaffff9d6"}
Jul 23 13:18:05.950784 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.950613    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:18:05.950784 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.950675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:18:05.950784 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.950724    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:18:05.952405 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.952366    2581 generic.go:356] "Generic (PLEG): container finished" podID="3db35aac-fa59-4811-ac8b-3ad5d14733c5" containerID="a35b80f808fcae1547295f8db4f1ecf0d257889061e8acbe710c6eeeb71acd5b" exitCode=0
Jul 23 13:18:05.952405 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.952404    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerDied","Data":"a35b80f808fcae1547295f8db4f1ecf0d257889061e8acbe710c6eeeb71acd5b"}
Jul 23 13:18:05.967812 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.967790    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:18:05.967915 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.967881    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:18:05.975081 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:05.975041    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fclht" podStartSLOduration=4.057666465 podStartE2EDuration="28.975027478s" totalImagesPullingTime="24.917361013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:05.974624302 +0000 UTC m=+29.647489743" watchObservedRunningTime="2026-07-23 13:18:05.975027478 +0000 UTC m=+29.647892919"
Jul 23 13:18:06.036586 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:06.036539    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn" podStartSLOduration=9.295697273 podStartE2EDuration="29.036525934s" totalImagesPullingTime="19.740828661s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:06.034912166 +0000 UTC m=+29.707777609" watchObservedRunningTime="2026-07-23 13:18:06.036525934 +0000 UTC m=+29.709391375"
Jul 23 13:18:06.813164 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:06.813132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:06.813663 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:06.813230    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:06.813663 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:06.813639    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:06.813771 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:06.813735    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:07.311002 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.310965    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d7j25"]
Jul 23 13:18:07.311171 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.311077    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:07.311232 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:07.311201    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:07.318916 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.318893    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjt2v"]
Jul 23 13:18:07.319021 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.318973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:07.319077 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:07.319054    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:07.326431 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.326402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ct4ws"]
Jul 23 13:18:07.326540 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.326525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:07.326660 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:07.326639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:18:07.686553 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.686521    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:18:07.686703 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.686621    2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 23 13:18:07.687305 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.687280    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vxb2v"
Jul 23 13:18:07.959343 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.959266    2581 generic.go:356] "Generic (PLEG): container finished" podID="3db35aac-fa59-4811-ac8b-3ad5d14733c5" containerID="a9a5f85e9fc636a02bb9b3c91434aa3db50ea706ab59c5bd6483518c4786db25" exitCode=0
Jul 23 13:18:07.959689 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:07.959343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerDied","Data":"a9a5f85e9fc636a02bb9b3c91434aa3db50ea706ab59c5bd6483518c4786db25"}
Jul 23 13:18:08.812256 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:08.812032    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:08.812406 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:08.812063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:08.812406 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:08.812339    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:08.812685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:08.812138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:08.812685 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:08.812468    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:18:08.812685 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:08.812511    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:09.966147 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:09.966116    2581 generic.go:356] "Generic (PLEG): container finished" podID="3db35aac-fa59-4811-ac8b-3ad5d14733c5" containerID="b368a86cf64851f610ff6a38cc77c67ace6441f5ac913bb3e0231745723f08ab" exitCode=0
Jul 23 13:18:09.966773 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:09.966176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerDied","Data":"b368a86cf64851f610ff6a38cc77c67ace6441f5ac913bb3e0231745723f08ab"}
Jul 23 13:18:10.492661 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:10.492618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:10.492823 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.492762    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 13:18:10.492869 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.492825    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret podName:7c202944-4918-447e-b505-4bb6ffb66ac6 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:42.492807967 +0000 UTC m=+66.165673390 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret") pod "global-pull-secret-syncer-hjt2v" (UID: "7c202944-4918-447e-b505-4bb6ffb66ac6") : object "kube-system"/"original-pull-secret" not registered
Jul 23 13:18:10.593006 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:10.592966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:10.593006 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:10.593012    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:10.593280 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.593154    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:18:10.593280 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.593169    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 13:18:10.593280 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.593187    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 13:18:10.593280 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.593199    2581 projected.go:196] Error preparing data for projected volume kube-api-access-pv7f9 for pod openshift-network-diagnostics/network-check-target-d7j25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:18:10.593280 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.593219    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs podName:86371a3a-c576-448a-8c28-3d148149da2f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:42.593202953 +0000 UTC m=+66.266068388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs") pod "network-metrics-daemon-ct4ws" (UID: "86371a3a-c576-448a-8c28-3d148149da2f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 13:18:10.593280 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.593247    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9 podName:9e4d6e4a-6e00-4e20-bc24-5a17879fe68f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:42.593232553 +0000 UTC m=+66.266097995 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pv7f9" (UniqueName: "kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9") pod "network-check-target-d7j25" (UID: "9e4d6e4a-6e00-4e20-bc24-5a17879fe68f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 13:18:10.811770 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:10.811690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:10.811770 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:10.811701    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:10.811984 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.811785    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d7j25" podUID="9e4d6e4a-6e00-4e20-bc24-5a17879fe68f"
Jul 23 13:18:10.811984 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.811869    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ct4ws" podUID="86371a3a-c576-448a-8c28-3d148149da2f"
Jul 23 13:18:10.811984 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:10.811905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:10.811984 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:10.811963    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hjt2v" podUID="7c202944-4918-447e-b505-4bb6ffb66ac6"
Jul 23 13:18:11.619786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.619761    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-235.ec2.internal" event="NodeReady"
Jul 23 13:18:11.620261 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.619878    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 13:18:11.677436 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.677410    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-szjfl"]
Jul 23 13:18:11.679166 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.679151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.685552 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.685527    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 23 13:18:11.685552 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.685531    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 23 13:18:11.685760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.685531    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.686356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.686333    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.687204 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.687183    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"]
Jul 23 13:18:11.687745 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.687590    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-c5pt5\""
Jul 23 13:18:11.688930 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.688912    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"]
Jul 23 13:18:11.689061 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.689042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:11.690639 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.690620    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"]
Jul 23 13:18:11.690772 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.690731    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.692851 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.692291    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"]
Jul 23 13:18:11.692851 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.692421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"
Jul 23 13:18:11.693942 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.693921    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 23 13:18:11.694032 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.693948    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6497b8bfb-mvn8k"]
Jul 23 13:18:11.694235 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.694215    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:11.695708 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.695692    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"]
Jul 23 13:18:11.695815 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.695801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.697566 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.697550    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.700299 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.700279    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.700416 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.700375    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 23 13:18:11.701017 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.701000    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9d57dd6c4-7w9tt"]
Jul 23 13:18:11.701640 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.701624    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.701835 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.701816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dfd6z\""
Jul 23 13:18:11.701929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.701635    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.701988 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.701637    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.702050 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.701631    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 23 13:18:11.702617 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.702597    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-67r7j"]
Jul 23 13:18:11.702696 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.702648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.703481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703462    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-vblc5\""
Jul 23 13:18:11.703585 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703561    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 23 13:18:11.703704 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703688    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-58cjb\""
Jul 23 13:18:11.703794 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703746    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.703794 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703775    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.703914 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 23 13:18:11.703914 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.703898    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 23 13:18:11.704068 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.704047    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 23 13:18:11.704164 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.704065    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.704246 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.704229    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 23 13:18:11.704819 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.704800    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 23 13:18:11.704939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.704899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 23 13:18:11.705037 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-psc5v\""
Jul 23 13:18:11.705118 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705042    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"]
Jul 23 13:18:11.705118 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705083    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nt6q9\""
Jul 23 13:18:11.705223 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.705303 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705289    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.705358 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705300    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kf7f4\""
Jul 23 13:18:11.705358 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705349    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.705454 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705032    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.705504 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 23 13:18:11.705893 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.705877    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 23 13:18:11.707210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.707192    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"]
Jul 23 13:18:11.707386 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.707351    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.709244 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.709223    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 13:18:11.710823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.710378    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-szjfl"]
Jul 23 13:18:11.710823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.710458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"
Jul 23 13:18:11.720817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.720166    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-bvz9n\""
Jul 23 13:18:11.720909 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.720875    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.722519 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.722501    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 13:18:11.722698 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.722666    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 23 13:18:11.722832 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.722819    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.722900 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.722843    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 13:18:11.722968 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.722951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xk9d7\""
Jul 23 13:18:11.723106 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723069    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723250    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723372    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723478    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723502    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qkwk8\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723534    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fnsmp\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723641    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.723758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723761    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.724408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.723734    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.725675 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.725192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 23 13:18:11.725675 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.725500    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 13:18:11.727071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.726986    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"]
Jul 23 13:18:11.736204 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.736179    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"]
Jul 23 13:18:11.736792 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.736769    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lp8gs"]
Jul 23 13:18:11.744117 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.742904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"]
Jul 23 13:18:11.744117 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.742939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"]
Jul 23 13:18:11.744117 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.742960    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hj9rr"]
Jul 23 13:18:11.744117 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.743138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:11.745247 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.745226    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"]
Jul 23 13:18:11.745356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.745267    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6497b8bfb-mvn8k"]
Jul 23 13:18:11.745356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.745315    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"]
Jul 23 13:18:11.745356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.745335    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"]
Jul 23 13:18:11.745356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.745350    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-67r7j"]
Jul 23 13:18:11.745547 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.745420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:11.746485 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.746465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 13:18:11.747502 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.747466    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-85swg\""
Jul 23 13:18:11.747686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.747664    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 13:18:11.748313 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.748297    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 13:18:11.748569 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.748547    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 13:18:11.748661 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.748512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m94bd\""
Jul 23 13:18:11.748701 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.748688    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9d57dd6c4-7w9tt"]
Jul 23 13:18:11.749065 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.749044    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 13:18:11.751226 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.751206    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lp8gs"]
Jul 23 13:18:11.763305 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.763283    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hj9rr"]
Jul 23 13:18:11.801963 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.801906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvhq7\" (UniqueName: \"kubernetes.io/projected/03965384-c042-4fc8-b6c4-a6ede7df7d8b-kube-api-access-rvhq7\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.801963 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.801941    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-default-certificate\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.802148 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.801969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6af983-9b53-4e8c-8671-51f16e936ef0-ca-trust-extracted\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802148 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6fb\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-kube-api-access-8k6fb\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802148 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29ad2808-523c-4f70-b446-61fd56da3bdd-serving-cert\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.802148 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.802294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802159    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:11.802294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802178    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6lbp\" (UniqueName: \"kubernetes.io/projected/29ad2808-523c-4f70-b446-61fd56da3bdd-kube-api-access-j6lbp\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.802294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-certificates\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-bound-sa-token\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btwd5\" (UniqueName: \"kubernetes.io/projected/cd515e9d-3675-4b1b-b5ba-d952156e835f-kube-api-access-btwd5\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.802476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-serving-cert\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.802476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.802476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67kvh\" (UniqueName: \"kubernetes.io/projected/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-kube-api-access-67kvh\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:11.802476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03965384-c042-4fc8-b6c4-a6ede7df7d8b-config\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.802476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03965384-c042-4fc8-b6c4-a6ede7df7d8b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.802476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd515e9d-3675-4b1b-b5ba-d952156e835f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-stats-auth\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xgff\" (UniqueName: \"kubernetes.io/projected/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-kube-api-access-2xgff\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802560    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-tmp\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg4hg\" (UniqueName: \"kubernetes.io/projected/d68280eb-f909-4ac6-83f1-4226ded01c05-kube-api-access-kg4hg\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29ad2808-523c-4f70-b446-61fd56da3bdd-config\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802620    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-installation-pull-secrets\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-service-ca-bundle\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.802672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg7vg\" (UniqueName: \"kubernetes.io/projected/38084d51-2f23-432a-a2b1-b5b1f0052f95-kube-api-access-mg7vg\") pod \"volume-data-source-validator-78cf4c6f6-2jb9r\" (UID: \"38084d51-2f23-432a-a2b1-b5b1f0052f95\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-snapshots\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802709    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8395b87-111d-466e-b079-de2d532879f4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f39f9671-1363-415c-ae2e-3be33b5c2fef-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802746    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-trusted-ca\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802818    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdpsp\" (UniqueName: \"kubernetes.io/projected/9d5d363b-6d11-461b-992e-60df17998470-kube-api-access-gdpsp\") pod \"network-check-source-7bc5b6bf85-tvdgj\" (UID: \"9d5d363b-6d11-461b-992e-60df17998470\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802882    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.802955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802924    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-image-registry-private-configuration\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.803228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8395b87-111d-466e-b079-de2d532879f4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.803228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.802999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.803228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.803022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29ad2808-523c-4f70-b446-61fd56da3bdd-trusted-ca\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.803228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.803063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b998r\" (UniqueName: \"kubernetes.io/projected/e8395b87-111d-466e-b079-de2d532879f4-kube-api-access-b998r\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.803228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.803116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:11.904237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b998r\" (UniqueName: \"kubernetes.io/projected/e8395b87-111d-466e-b079-de2d532879f4-kube-api-access-b998r\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.904435 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:11.904435 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904283    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvhq7\" (UniqueName: \"kubernetes.io/projected/03965384-c042-4fc8-b6c4-a6ede7df7d8b-kube-api-access-rvhq7\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.904435 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-default-certificate\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.904435 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.904417    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6af983-9b53-4e8c-8671-51f16e936ef0-ca-trust-extracted\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904483    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6fb\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-kube-api-access-8k6fb\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.904499    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls podName:30d768cc-a8cf-4ad9-ad86-0d595ab8efbb nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.404478545 +0000 UTC m=+36.077343978 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vlxgp" (UID: "30d768cc-a8cf-4ad9-ad86-0d595ab8efbb") : secret "samples-operator-tls" not found
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29ad2808-523c-4f70-b446-61fd56da3bdd-serving-cert\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904608    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s4cx\" (UniqueName: \"kubernetes.io/projected/0270273c-d91f-4785-8293-e2c593a1219c-kube-api-access-9s4cx\") pod \"ingress-canary-lp8gs\" (UID: \"0270273c-d91f-4785-8293-e2c593a1219c\") " pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:11.904636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrmjl\" (UniqueName: \"kubernetes.io/projected/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-kube-api-access-jrmjl\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6lbp\" (UniqueName: \"kubernetes.io/projected/29ad2808-523c-4f70-b446-61fd56da3bdd-kube-api-access-j6lbp\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.904695    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904709    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-certificates\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-bound-sa-token\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.904753    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls podName:cd515e9d-3675-4b1b-b5ba-d952156e835f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.404737724 +0000 UTC m=+36.077603163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w2fdv" (UID: "cd515e9d-3675-4b1b-b5ba-d952156e835f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.904775    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwd5\" (UniqueName: \"kubernetes.io/projected/cd515e9d-3675-4b1b-b5ba-d952156e835f-kube-api-access-btwd5\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.904835    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert podName:f39f9671-1363-415c-ae2e-3be33b5c2fef nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.40481815 +0000 UTC m=+36.077683593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nrx2w" (UID: "f39f9671-1363-415c-ae2e-3be33b5c2fef") : secret "networking-console-plugin-cert" not found
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904830    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6af983-9b53-4e8c-8671-51f16e936ef0-ca-trust-extracted\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-serving-cert\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904898    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67kvh\" (UniqueName: \"kubernetes.io/projected/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-kube-api-access-67kvh\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:11.904992 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904957    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03965384-c042-4fc8-b6c4-a6ede7df7d8b-config\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.904981    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-tmp-dir\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03965384-c042-4fc8-b6c4-a6ede7df7d8b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd515e9d-3675-4b1b-b5ba-d952156e835f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.905050    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.405033925 +0000 UTC m=+36.077899348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : configmap references non-existent config key: service-ca.crt
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-stats-auth\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xgff\" (UniqueName: \"kubernetes.io/projected/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-kube-api-access-2xgff\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905194    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-tmp\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg4hg\" (UniqueName: \"kubernetes.io/projected/d68280eb-f909-4ac6-83f1-4226ded01c05-kube-api-access-kg4hg\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29ad2808-523c-4f70-b446-61fd56da3bdd-config\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-config-volume\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-installation-pull-secrets\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-service-ca-bundle\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg7vg\" (UniqueName: \"kubernetes.io/projected/38084d51-2f23-432a-a2b1-b5b1f0052f95-kube-api-access-mg7vg\") pod \"volume-data-source-validator-78cf4c6f6-2jb9r\" (UID: \"38084d51-2f23-432a-a2b1-b5b1f0052f95\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-snapshots\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.905658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905418    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8395b87-111d-466e-b079-de2d532879f4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905446    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f39f9671-1363-415c-ae2e-3be33b5c2fef-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905470    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-trusted-ca\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905501    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdpsp\" (UniqueName: \"kubernetes.io/projected/9d5d363b-6d11-461b-992e-60df17998470-kube-api-access-gdpsp\") pod \"network-check-source-7bc5b6bf85-tvdgj\" (UID: \"9d5d363b-6d11-461b-992e-60df17998470\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-certificates\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905557    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/03965384-c042-4fc8-b6c4-a6ede7df7d8b-config\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-image-registry-private-configuration\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905647    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0270273c-d91f-4785-8293-e2c593a1219c-cert\") pod \"ingress-canary-lp8gs\" (UID: \"0270273c-d91f-4785-8293-e2c593a1219c\") " pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8395b87-111d-466e-b079-de2d532879f4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905695    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29ad2808-523c-4f70-b446-61fd56da3bdd-trusted-ca\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.906283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.905756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/cd515e9d-3675-4b1b-b5ba-d952156e835f-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.906995 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.906493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.906995 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.906680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29ad2808-523c-4f70-b446-61fd56da3bdd-trusted-ca\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.906995 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.906810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-tmp\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.906995 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.906905    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:18:11.906995 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.906917    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9d57dd6c4-7w9tt: secret "image-registry-tls" not found
Jul 23 13:18:11.906995 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.906955    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls podName:6f6af983-9b53-4e8c-8671-51f16e936ef0 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.406942391 +0000 UTC m=+36.079807830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls") pod "image-registry-9d57dd6c4-7w9tt" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0") : secret "image-registry-tls" not found
Jul 23 13:18:11.907299 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.907152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f39f9671-1363-415c-ae2e-3be33b5c2fef-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:11.907299 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.907281    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-service-ca-bundle\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.907784 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.907764    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:18:11.911010 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:11.910991    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.410976862 +0000 UTC m=+36.083842281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : secret "router-metrics-certs-default" not found
Jul 23 13:18:11.911010 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.907938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/29ad2808-523c-4f70-b446-61fd56da3bdd-config\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.911231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.907979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e8395b87-111d-466e-b079-de2d532879f4-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.911231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.908417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-snapshots\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.911231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.910575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-stats-auth\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.911231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.910661    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e8395b87-111d-466e-b079-de2d532879f4-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.911231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.910937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-installation-pull-secrets\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.911231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.907938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-trusted-ca\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.911783 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.911740    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/03965384-c042-4fc8-b6c4-a6ede7df7d8b-serving-cert\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.911957 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.911902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/29ad2808-523c-4f70-b446-61fd56da3bdd-serving-cert\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.911957 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.911939    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-default-certificate\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.912351 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.912220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-image-registry-private-configuration\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.913080 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.912880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-serving-cert\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.915518 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.915148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6lbp\" (UniqueName: \"kubernetes.io/projected/29ad2808-523c-4f70-b446-61fd56da3bdd-kube-api-access-j6lbp\") pod \"console-operator-565b7b569d-67r7j\" (UID: \"29ad2808-523c-4f70-b446-61fd56da3bdd\") " pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:11.916499 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.916270    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvhq7\" (UniqueName: \"kubernetes.io/projected/03965384-c042-4fc8-b6c4-a6ede7df7d8b-kube-api-access-rvhq7\") pod \"service-ca-operator-5bcbc94c78-wn6xq\" (UID: \"03965384-c042-4fc8-b6c4-a6ede7df7d8b\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:11.916499 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.916443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6fb\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-kube-api-access-8k6fb\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.916499 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.916465    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67kvh\" (UniqueName: \"kubernetes.io/projected/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-kube-api-access-67kvh\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:11.916694 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.916528    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b998r\" (UniqueName: \"kubernetes.io/projected/e8395b87-111d-466e-b079-de2d532879f4-kube-api-access-b998r\") pod \"kube-storage-version-migrator-operator-7658d9b749-9tvch\" (UID: \"e8395b87-111d-466e-b079-de2d532879f4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:11.917434 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.917415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdpsp\" (UniqueName: \"kubernetes.io/projected/9d5d363b-6d11-461b-992e-60df17998470-kube-api-access-gdpsp\") pod \"network-check-source-7bc5b6bf85-tvdgj\" (UID: \"9d5d363b-6d11-461b-992e-60df17998470\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"
Jul 23 13:18:11.917562 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.917514    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-bound-sa-token\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:11.918222 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.918200    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btwd5\" (UniqueName: \"kubernetes.io/projected/cd515e9d-3675-4b1b-b5ba-d952156e835f-kube-api-access-btwd5\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:11.921761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.921717    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg4hg\" (UniqueName: \"kubernetes.io/projected/d68280eb-f909-4ac6-83f1-4226ded01c05-kube-api-access-kg4hg\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:11.921761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.921727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg7vg\" (UniqueName: \"kubernetes.io/projected/38084d51-2f23-432a-a2b1-b5b1f0052f95-kube-api-access-mg7vg\") pod \"volume-data-source-validator-78cf4c6f6-2jb9r\" (UID: \"38084d51-2f23-432a-a2b1-b5b1f0052f95\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"
Jul 23 13:18:11.924248 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.924227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xgff\" (UniqueName: \"kubernetes.io/projected/0fa6d26a-1db4-42d8-8d3f-85698faa9e1e-kube-api-access-2xgff\") pod \"insights-operator-555d9d7885-szjfl\" (UID: \"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e\") " pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:11.940505 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.940478    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxb2v_c0a03f86-7ad0-4bdf-843e-e450f1580dac/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:11.991927 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:11.991897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-szjfl"
Jul 23 13:18:12.006942 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.006915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s4cx\" (UniqueName: \"kubernetes.io/projected/0270273c-d91f-4785-8293-e2c593a1219c-kube-api-access-9s4cx\") pod \"ingress-canary-lp8gs\" (UID: \"0270273c-d91f-4785-8293-e2c593a1219c\") " pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:12.007056 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.006955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrmjl\" (UniqueName: \"kubernetes.io/projected/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-kube-api-access-jrmjl\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.007056 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.007011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.007187 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.007141    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:18:12.007187 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.007177    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-tmp-dir\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.007287 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.007197    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls podName:4d9aea88-b36a-4bd5-81ec-542b5a642c6b nodeName:}" failed. No retries permitted until 2026-07-23 13:18:12.50717889 +0000 UTC m=+36.180044326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls") pod "dns-default-hj9rr" (UID: "4d9aea88-b36a-4bd5-81ec-542b5a642c6b") : secret "dns-default-metrics-tls" not found
Jul 23 13:18:12.007287 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.007254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-config-volume\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.007391 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.007322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0270273c-d91f-4785-8293-e2c593a1219c-cert\") pod \"ingress-canary-lp8gs\" (UID: \"0270273c-d91f-4785-8293-e2c593a1219c\") " pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:12.007499 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.007476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-tmp-dir\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.007800 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.007759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-config-volume\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.010396 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.010376    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0270273c-d91f-4785-8293-e2c593a1219c-cert\") pod \"ingress-canary-lp8gs\" (UID: \"0270273c-d91f-4785-8293-e2c593a1219c\") " pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:12.018838 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.018814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"
Jul 23 13:18:12.019787 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.019769    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrmjl\" (UniqueName: \"kubernetes.io/projected/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-kube-api-access-jrmjl\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.020301 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.020269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s4cx\" (UniqueName: \"kubernetes.io/projected/0270273c-d91f-4785-8293-e2c593a1219c-kube-api-access-9s4cx\") pod \"ingress-canary-lp8gs\" (UID: \"0270273c-d91f-4785-8293-e2c593a1219c\") " pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:12.051116 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.051063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"
Jul 23 13:18:12.053048 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.052976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxb2v_c0a03f86-7ad0-4bdf-843e-e450f1580dac/konnectivity-agent/0.log" limit=1024
Jul 23 13:18:12.067819 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.067684    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:12.076711 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.076531    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"
Jul 23 13:18:12.081617 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.081590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"
Jul 23 13:18:12.088740 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.088599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lp8gs"
Jul 23 13:18:12.192325 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.187139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-szjfl"]
Jul 23 13:18:12.249220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.249184    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r"]
Jul 23 13:18:12.300737 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.300656    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch"]
Jul 23 13:18:12.305199 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:12.305103    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8395b87_111d_466e_b079_de2d532879f4.slice/crio-f4d061d977db5e95f4596a34f43ff26993a381808cf942729384da4f00ae9d49 WatchSource:0}: Error finding container f4d061d977db5e95f4596a34f43ff26993a381808cf942729384da4f00ae9d49: Status 404 returned error can't find the container with id f4d061d977db5e95f4596a34f43ff26993a381808cf942729384da4f00ae9d49
Jul 23 13:18:12.330168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.330139    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-67r7j"]
Jul 23 13:18:12.333998 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:12.333969    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29ad2808_523c_4f70_b446_61fd56da3bdd.slice/crio-9be1afde668ed2f7d3a19a99c5bcc8c1a9144c0cb19d761903708e24300e246d WatchSource:0}: Error finding container 9be1afde668ed2f7d3a19a99c5bcc8c1a9144c0cb19d761903708e24300e246d: Status 404 returned error can't find the container with id 9be1afde668ed2f7d3a19a99c5bcc8c1a9144c0cb19d761903708e24300e246d
Jul 23 13:18:12.338875 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.338854    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq"]
Jul 23 13:18:12.341986 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:12.341944    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03965384_c042_4fc8_b6c4_a6ede7df7d8b.slice/crio-15c72488785b2aa681da6982b91a91011dfd59b093724e560045681f0ebe1123 WatchSource:0}: Error finding container 15c72488785b2aa681da6982b91a91011dfd59b093724e560045681f0ebe1123: Status 404 returned error can't find the container with id 15c72488785b2aa681da6982b91a91011dfd59b093724e560045681f0ebe1123
Jul 23 13:18:12.354278 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.354253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lp8gs"]
Jul 23 13:18:12.357613 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:12.357589    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0270273c_d91f_4785_8293_e2c593a1219c.slice/crio-5f94cdf89cc87669263b578b3184580c648948bc39240fcef6377ffadc2515ad WatchSource:0}: Error finding container 5f94cdf89cc87669263b578b3184580c648948bc39240fcef6377ffadc2515ad: Status 404 returned error can't find the container with id 5f94cdf89cc87669263b578b3184580c648948bc39240fcef6377ffadc2515ad
Jul 23 13:18:12.357843 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.357825    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj"]
Jul 23 13:18:12.360509 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:12.360482    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d5d363b_6d11_461b_992e_60df17998470.slice/crio-22b80ede1690883e3ae257afe14bacd80034210db30a4afe605fbe45466c3f2f WatchSource:0}: Error finding container 22b80ede1690883e3ae257afe14bacd80034210db30a4afe605fbe45466c3f2f: Status 404 returned error can't find the container with id 22b80ede1690883e3ae257afe14bacd80034210db30a4afe605fbe45466c3f2f
Jul 23 13:18:12.414793 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.414760    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:12.414933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.414807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:12.414933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.414831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:12.414933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.414871    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:12.414933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.414893    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.414934    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.414938    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.414949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.414960    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9d57dd6c4-7w9tt: secret "image-registry-tls" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.414987    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.414972955 +0000 UTC m=+37.087838374 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : secret "router-metrics-certs-default" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415011    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls podName:6f6af983-9b53-4e8c-8671-51f16e936ef0 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.4150005 +0000 UTC m=+37.087865922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls") pod "image-registry-9d57dd6c4-7w9tt" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0") : secret "image-registry-tls" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415052    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415055    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.415038974 +0000 UTC m=+37.087904395 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : configmap references non-existent config key: service-ca.crt
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415108    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls podName:cd515e9d-3675-4b1b-b5ba-d952156e835f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.415075321 +0000 UTC m=+37.087940742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w2fdv" (UID: "cd515e9d-3675-4b1b-b5ba-d952156e835f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415166    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:18:12.415174 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415169    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:18:12.415567 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415198    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls podName:30d768cc-a8cf-4ad9-ad86-0d595ab8efbb nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.415187073 +0000 UTC m=+37.088052496 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vlxgp" (UID: "30d768cc-a8cf-4ad9-ad86-0d595ab8efbb") : secret "samples-operator-tls" not found
Jul 23 13:18:12.415567 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.415215    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert podName:f39f9671-1363-415c-ae2e-3be33b5c2fef nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.415204284 +0000 UTC m=+37.088069707 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nrx2w" (UID: "f39f9671-1363-415c-ae2e-3be33b5c2fef") : secret "networking-console-plugin-cert" not found
Jul 23 13:18:12.515559 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.515513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:12.515740 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.515674    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:18:12.515791 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:12.515744    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls podName:4d9aea88-b36a-4bd5-81ec-542b5a642c6b nodeName:}" failed. No retries permitted until 2026-07-23 13:18:13.51572849 +0000 UTC m=+37.188593909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls") pod "dns-default-hj9rr" (UID: "4d9aea88-b36a-4bd5-81ec-542b5a642c6b") : secret "dns-default-metrics-tls" not found
Jul 23 13:18:12.812276 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.812249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:12.812892 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.812762    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:12.812953 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.812908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:12.816783 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.816761    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:18:12.818188 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.818168    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4ww68\""
Jul 23 13:18:12.818419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.818404    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:18:12.818640 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.818622    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42dd2\""
Jul 23 13:18:12.976113 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.976034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-szjfl" event={"ID":"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e","Type":"ContainerStarted","Data":"cea63068bcdcaee3ca812cc3ba5ebb35b3e62e6bc1f4d48254170dfccd06f349"}
Jul 23 13:18:12.978554 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.978526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj" event={"ID":"9d5d363b-6d11-461b-992e-60df17998470","Type":"ContainerStarted","Data":"22b80ede1690883e3ae257afe14bacd80034210db30a4afe605fbe45466c3f2f"}
Jul 23 13:18:12.981333 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.981281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch" event={"ID":"e8395b87-111d-466e-b079-de2d532879f4","Type":"ContainerStarted","Data":"f4d061d977db5e95f4596a34f43ff26993a381808cf942729384da4f00ae9d49"}
Jul 23 13:18:12.983056 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.982996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lp8gs" event={"ID":"0270273c-d91f-4785-8293-e2c593a1219c","Type":"ContainerStarted","Data":"5f94cdf89cc87669263b578b3184580c648948bc39240fcef6377ffadc2515ad"}
Jul 23 13:18:12.984792 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.984716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq" event={"ID":"03965384-c042-4fc8-b6c4-a6ede7df7d8b","Type":"ContainerStarted","Data":"15c72488785b2aa681da6982b91a91011dfd59b093724e560045681f0ebe1123"}
Jul 23 13:18:12.986153 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.986108    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" event={"ID":"29ad2808-523c-4f70-b446-61fd56da3bdd","Type":"ContainerStarted","Data":"9be1afde668ed2f7d3a19a99c5bcc8c1a9144c0cb19d761903708e24300e246d"}
Jul 23 13:18:12.987939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:12.987881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r" event={"ID":"38084d51-2f23-432a-a2b1-b5b1f0052f95","Type":"ContainerStarted","Data":"19e6e4abde5ff98c0cdc178db6342ed2e9c602ccc0c214a0851b8b64351c3bc9"}
Jul 23 13:18:13.425963 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.425926    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:13.426210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.426022    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:13.426210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.426060    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:13.426210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.426096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:13.426210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.426133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:13.426210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.426153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:13.426477 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426301    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.426281545 +0000 UTC m=+39.099146965 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : configmap references non-existent config key: service-ca.crt
Jul 23 13:18:13.426789 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426767    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:18:13.426864 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426832    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls podName:30d768cc-a8cf-4ad9-ad86-0d595ab8efbb nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.426815799 +0000 UTC m=+39.099681237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vlxgp" (UID: "30d768cc-a8cf-4ad9-ad86-0d595ab8efbb") : secret "samples-operator-tls" not found
Jul 23 13:18:13.426924 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426901    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:18:13.427033 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426930    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:18:13.427033 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426948    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9d57dd6c4-7w9tt: secret "image-registry-tls" not found
Jul 23 13:18:13.427033 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426936    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.426924117 +0000 UTC m=+39.099789543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : secret "router-metrics-certs-default" not found
Jul 23 13:18:13.427033 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426995    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:18:13.427033 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.426998    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls podName:6f6af983-9b53-4e8c-8671-51f16e936ef0 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.426984396 +0000 UTC m=+39.099849814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls") pod "image-registry-9d57dd6c4-7w9tt" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0") : secret "image-registry-tls" not found
Jul 23 13:18:13.427033 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.427026    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert podName:f39f9671-1363-415c-ae2e-3be33b5c2fef nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.427016298 +0000 UTC m=+39.099881720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nrx2w" (UID: "f39f9671-1363-415c-ae2e-3be33b5c2fef") : secret "networking-console-plugin-cert" not found
Jul 23 13:18:13.427561 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.427045    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:13.427561 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.427074    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls podName:cd515e9d-3675-4b1b-b5ba-d952156e835f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.427067591 +0000 UTC m=+39.099933011 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w2fdv" (UID: "cd515e9d-3675-4b1b-b5ba-d952156e835f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:13.527319 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:13.527286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:13.527497 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.527479    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:18:13.527578 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:13.527543    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls podName:4d9aea88-b36a-4bd5-81ec-542b5a642c6b nodeName:}" failed. No retries permitted until 2026-07-23 13:18:15.527525399 +0000 UTC m=+39.200390824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls") pod "dns-default-hj9rr" (UID: "4d9aea88-b36a-4bd5-81ec-542b5a642c6b") : secret "dns-default-metrics-tls" not found
Jul 23 13:18:15.447668 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.447633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.447692    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.447718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447821    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447831    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447842    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9d57dd6c4-7w9tt: secret "image-registry-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.447870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447893    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls podName:30d768cc-a8cf-4ad9-ad86-0d595ab8efbb nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.447876293 +0000 UTC m=+43.120741711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vlxgp" (UID: "30d768cc-a8cf-4ad9-ad86-0d595ab8efbb") : secret "samples-operator-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447817    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447919    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls podName:6f6af983-9b53-4e8c-8671-51f16e936ef0 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.447904097 +0000 UTC m=+43.120769543 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls") pod "image-registry-9d57dd6c4-7w9tt" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0") : secret "image-registry-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447932    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447941    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.44793201 +0000 UTC m=+43.120797435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : secret "router-metrics-certs-default" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.447967    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls podName:cd515e9d-3675-4b1b-b5ba-d952156e835f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.447957828 +0000 UTC m=+43.120823248 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w2fdv" (UID: "cd515e9d-3675-4b1b-b5ba-d952156e835f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.447983    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.448028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:15.448237 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.448113    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:18:15.448852 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.448172    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert podName:f39f9671-1363-415c-ae2e-3be33b5c2fef nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.448157058 +0000 UTC m=+43.121022488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nrx2w" (UID: "f39f9671-1363-415c-ae2e-3be33b5c2fef") : secret "networking-console-plugin-cert" not found
Jul 23 13:18:15.448852 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.448193    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.448183265 +0000 UTC m=+43.121048685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : configmap references non-existent config key: service-ca.crt
Jul 23 13:18:15.549069 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:15.549033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:15.549234 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.549207    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:18:15.549307 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:15.549275    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls podName:4d9aea88-b36a-4bd5-81ec-542b5a642c6b nodeName:}" failed. No retries permitted until 2026-07-23 13:18:19.549260475 +0000 UTC m=+43.222125895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls") pod "dns-default-hj9rr" (UID: "4d9aea88-b36a-4bd5-81ec-542b5a642c6b") : secret "dns-default-metrics-tls" not found
Jul 23 13:18:19.484885 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.484855    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.484909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.484931    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.484965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.484998    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.485017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.485056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485082    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485120    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls podName:30d768cc-a8cf-4ad9-ad86-0d595ab8efbb nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.485102732 +0000 UTC m=+51.157968166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vlxgp" (UID: "30d768cc-a8cf-4ad9-ad86-0d595ab8efbb") : secret "samples-operator-tls" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485082    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485168    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls podName:cd515e9d-3675-4b1b-b5ba-d952156e835f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.485146052 +0000 UTC m=+51.158011477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w2fdv" (UID: "cd515e9d-3675-4b1b-b5ba-d952156e835f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485175    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485201    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.485183507 +0000 UTC m=+51.158048933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : configmap references non-existent config key: service-ca.crt
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485218    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485226    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert podName:f39f9671-1363-415c-ae2e-3be33b5c2fef nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.485216523 +0000 UTC m=+51.158081946 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nrx2w" (UID: "f39f9671-1363-415c-ae2e-3be33b5c2fef") : secret "networking-console-plugin-cert" not found
Jul 23 13:18:19.485258 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485237    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9d57dd6c4-7w9tt: secret "image-registry-tls" not found
Jul 23 13:18:19.485726 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485253    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.48524321 +0000 UTC m=+51.158108629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : secret "router-metrics-certs-default" not found
Jul 23 13:18:19.485726 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.485303    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls podName:6f6af983-9b53-4e8c-8671-51f16e936ef0 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.485287178 +0000 UTC m=+51.158152620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls") pod "image-registry-9d57dd6c4-7w9tt" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0") : secret "image-registry-tls" not found
Jul 23 13:18:19.585515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:19.585465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:19.585594 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.585581    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:18:19.585628 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:19.585623    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls podName:4d9aea88-b36a-4bd5-81ec-542b5a642c6b nodeName:}" failed. No retries permitted until 2026-07-23 13:18:27.585612633 +0000 UTC m=+51.258478051 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls") pod "dns-default-hj9rr" (UID: "4d9aea88-b36a-4bd5-81ec-542b5a642c6b") : secret "dns-default-metrics-tls" not found
Jul 23 13:18:22.014608 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.014526    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-szjfl" event={"ID":"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e","Type":"ContainerStarted","Data":"8754cba175ae31b0714393d039d655fa98ce48cbaa9787c5b87998de0bf88b4a"}
Jul 23 13:18:22.016686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.016630    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj" event={"ID":"9d5d363b-6d11-461b-992e-60df17998470","Type":"ContainerStarted","Data":"031e6b870029b4237de0b71fd1a6815f95ded5cee758a6b21f79fb3cfa39969d"}
Jul 23 13:18:22.018109 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.018028    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch" event={"ID":"e8395b87-111d-466e-b079-de2d532879f4","Type":"ContainerStarted","Data":"e6715ccc3b3db2c7465d10eb54c2c74df934dd4e6b3f565db5bebbaf3482fca8"}
Jul 23 13:18:22.021366 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.021339    2581 generic.go:356] "Generic (PLEG): container finished" podID="3db35aac-fa59-4811-ac8b-3ad5d14733c5" containerID="59686847fc078e286f3be11f0fb728e5c7fa604010a20b3dcc048c28d03dbb15" exitCode=0
Jul 23 13:18:22.021457 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.021419    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerDied","Data":"59686847fc078e286f3be11f0fb728e5c7fa604010a20b3dcc048c28d03dbb15"}
Jul 23 13:18:22.023158 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.023135    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lp8gs" event={"ID":"0270273c-d91f-4785-8293-e2c593a1219c","Type":"ContainerStarted","Data":"e27b817426827eb1897ffd356ad46e2d7253a7e3f8d78508dc84df24c2aa75de"}
Jul 23 13:18:22.025373 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.025117    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq" event={"ID":"03965384-c042-4fc8-b6c4-a6ede7df7d8b","Type":"ContainerStarted","Data":"84408204e1fbc99cb5f02415ee3f67ec142f362d247f17a02de1673e80cb453f"}
Jul 23 13:18:22.026879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.026852    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/0.log"
Jul 23 13:18:22.026975 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.026892    2581 generic.go:356] "Generic (PLEG): container finished" podID="29ad2808-523c-4f70-b446-61fd56da3bdd" containerID="aa8b3795e82b773b14f05d7a40ed641403e4c29391055cb15768c63fef1b3fee" exitCode=255
Jul 23 13:18:22.027298 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.027057    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" event={"ID":"29ad2808-523c-4f70-b446-61fd56da3bdd","Type":"ContainerDied","Data":"aa8b3795e82b773b14f05d7a40ed641403e4c29391055cb15768c63fef1b3fee"}
Jul 23 13:18:22.027298 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.027218    2581 scope.go:117] "RemoveContainer" containerID="aa8b3795e82b773b14f05d7a40ed641403e4c29391055cb15768c63fef1b3fee"
Jul 23 13:18:22.029202 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.029169    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r" event={"ID":"38084d51-2f23-432a-a2b1-b5b1f0052f95","Type":"ContainerStarted","Data":"16a25ace55d559f74ac2ab196c91bfe7bf2d4d7d7be87441ed0f0f97b1c71bda"}
Jul 23 13:18:22.035495 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.035450    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-szjfl" podStartSLOduration=24.903749929 podStartE2EDuration="34.035425582s" totalImagesPullingTime="9.131675653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:22.035020721 +0000 UTC m=+45.707886162" watchObservedRunningTime="2026-07-23 13:18:22.035425582 +0000 UTC m=+45.708291005"
Jul 23 13:18:22.053321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.053242    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch" podStartSLOduration=14.041353275 podStartE2EDuration="23.053226944s" totalImagesPullingTime="9.011873669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:22.052854646 +0000 UTC m=+45.725720094" watchObservedRunningTime="2026-07-23 13:18:22.053226944 +0000 UTC m=+45.726092387"
Jul 23 13:18:22.072192 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.072171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:22.072258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.072230    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:22.130590 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.129363    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq" podStartSLOduration=14.152834876 podStartE2EDuration="23.129343174s" totalImagesPullingTime="8.976508298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:22.105578599 +0000 UTC m=+45.778444042" watchObservedRunningTime="2026-07-23 13:18:22.129343174 +0000 UTC m=+45.802208615"
Jul 23 13:18:22.171803 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.171753    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-tvdgj" podStartSLOduration=8.213680415 podStartE2EDuration="17.171736486s" totalImagesPullingTime="8.958056071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:22.149880887 +0000 UTC m=+45.822746330" watchObservedRunningTime="2026-07-23 13:18:22.171736486 +0000 UTC m=+45.844601926"
Jul 23 13:18:22.192927 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.192869    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lp8gs" podStartSLOduration=2.200407282 podStartE2EDuration="11.192847884s" totalImagesPullingTime="8.992440602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:22.172455456 +0000 UTC m=+45.845320898" watchObservedRunningTime="2026-07-23 13:18:22.192847884 +0000 UTC m=+45.865713325"
Jul 23 13:18:22.193562 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.193527    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-2jb9r" podStartSLOduration=15.135051792 podStartE2EDuration="24.193518182s" totalImagesPullingTime="9.05846639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:22.192374542 +0000 UTC m=+45.865239983" watchObservedRunningTime="2026-07-23 13:18:22.193518182 +0000 UTC m=+45.866383625"
Jul 23 13:18:22.537805 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.536973    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9rssb"]
Jul 23 13:18:22.569316 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.569249    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9rssb"]
Jul 23 13:18:22.569428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.569373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.572379 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.572349    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vwfmr\""
Jul 23 13:18:22.572580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.572507    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 13:18:22.573022 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.573002    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 13:18:22.649493 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.649461    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"]
Jul 23 13:18:22.668701 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.668676    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"]
Jul 23 13:18:22.668839 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.668772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"
Jul 23 13:18:22.671783 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.671762    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 23 13:18:22.671896 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.671762    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hpfff\""
Jul 23 13:18:22.671896 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.671801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 23 13:18:22.713988 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.713966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.714083 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.714056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.714192 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.714172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n6dm\" (UniqueName: \"kubernetes.io/projected/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-api-access-9n6dm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.714226 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.714209    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56ce1c97-cbff-49a6-aaa9-273612cdf216-crio-socket\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.714269 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.714254    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ce1c97-cbff-49a6-aaa9-273612cdf216-data-volume\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.814626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.814601    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spkpt\" (UniqueName: \"kubernetes.io/projected/18e8232e-5e5b-47d2-9c68-509ae88cf59d-kube-api-access-spkpt\") pod \"migrator-7cc9c7ffd7-b475p\" (UID: \"18e8232e-5e5b-47d2-9c68-509ae88cf59d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"
Jul 23 13:18:22.814756 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.814671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.814756 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.814746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n6dm\" (UniqueName: \"kubernetes.io/projected/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-api-access-9n6dm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.814861 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.814778    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56ce1c97-cbff-49a6-aaa9-273612cdf216-crio-socket\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.814861 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:22.814799    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:22.814861 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.814822    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ce1c97-cbff-49a6-aaa9-273612cdf216-data-volume\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.815009 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:22.814872    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:23.314853222 +0000 UTC m=+46.987718643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:22.815072 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.815024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.815182 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.815152    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/56ce1c97-cbff-49a6-aaa9-273612cdf216-data-volume\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.815301 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:22.815215    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:18:22.815301 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:22.815276    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:23.31526052 +0000 UTC m=+46.988125944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : configmap "kube-rbac-proxy" not found
Jul 23 13:18:22.815415 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.815387    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/56ce1c97-cbff-49a6-aaa9-273612cdf216-crio-socket\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.827469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.827414    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n6dm\" (UniqueName: \"kubernetes.io/projected/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-api-access-9n6dm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:22.915420 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.915396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spkpt\" (UniqueName: \"kubernetes.io/projected/18e8232e-5e5b-47d2-9c68-509ae88cf59d-kube-api-access-spkpt\") pod \"migrator-7cc9c7ffd7-b475p\" (UID: \"18e8232e-5e5b-47d2-9c68-509ae88cf59d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"
Jul 23 13:18:22.924762 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.924731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spkpt\" (UniqueName: \"kubernetes.io/projected/18e8232e-5e5b-47d2-9c68-509ae88cf59d-kube-api-access-spkpt\") pod \"migrator-7cc9c7ffd7-b475p\" (UID: \"18e8232e-5e5b-47d2-9c68-509ae88cf59d\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"
Jul 23 13:18:22.978535 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:22.978511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"
Jul 23 13:18:23.036373 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.036341    2581 generic.go:356] "Generic (PLEG): container finished" podID="3db35aac-fa59-4811-ac8b-3ad5d14733c5" containerID="d8ceed97690b29c0b09d5d32eedd94a0152864adc509eb7dabece31939998a22" exitCode=0
Jul 23 13:18:23.036715 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.036422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerDied","Data":"d8ceed97690b29c0b09d5d32eedd94a0152864adc509eb7dabece31939998a22"}
Jul 23 13:18:23.038307 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.038279    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:18:23.038676 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.038658    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/0.log"
Jul 23 13:18:23.038750 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.038697    2581 generic.go:356] "Generic (PLEG): container finished" podID="29ad2808-523c-4f70-b446-61fd56da3bdd" containerID="b2b4c5a394b9856a03c3f39ed5e6791521d963d769dfab745b66ed9d9d6bb0a6" exitCode=255
Jul 23 13:18:23.038973 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.038952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" event={"ID":"29ad2808-523c-4f70-b446-61fd56da3bdd","Type":"ContainerDied","Data":"b2b4c5a394b9856a03c3f39ed5e6791521d963d769dfab745b66ed9d9d6bb0a6"}
Jul 23 13:18:23.039019 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.039009    2581 scope.go:117] "RemoveContainer" containerID="aa8b3795e82b773b14f05d7a40ed641403e4c29391055cb15768c63fef1b3fee"
Jul 23 13:18:23.039055 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.039038    2581 scope.go:117] "RemoveContainer" containerID="b2b4c5a394b9856a03c3f39ed5e6791521d963d769dfab745b66ed9d9d6bb0a6"
Jul 23 13:18:23.039225 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:23.039206    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-67r7j_openshift-console-operator(29ad2808-523c-4f70-b446-61fd56da3bdd)\"" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" podUID="29ad2808-523c-4f70-b446-61fd56da3bdd"
Jul 23 13:18:23.151318 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.151239    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p"]
Jul 23 13:18:23.153125 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:23.153077    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18e8232e_5e5b_47d2_9c68_509ae88cf59d.slice/crio-c246f2fbf05962c983e1a67012beac011fa13147bad139b831ad3a57ff1391bd WatchSource:0}: Error finding container c246f2fbf05962c983e1a67012beac011fa13147bad139b831ad3a57ff1391bd: Status 404 returned error can't find the container with id c246f2fbf05962c983e1a67012beac011fa13147bad139b831ad3a57ff1391bd
Jul 23 13:18:23.319504 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.319477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:23.319626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.319586    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:23.319626 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:23.319591    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:18:23.319748 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:23.319647    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:24.31963359 +0000 UTC m=+47.992499009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : configmap "kube-rbac-proxy" not found
Jul 23 13:18:23.319748 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:23.319682    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:23.319748 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:23.319733    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:24.319718337 +0000 UTC m=+47.992583757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:23.707246 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:23.707219    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x8p5f_8baab27e-7c43-4f63-9b8a-b289a0727d62/dns-node-resolver/0.log"
Jul 23 13:18:24.045320 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.045238    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" event={"ID":"3db35aac-fa59-4811-ac8b-3ad5d14733c5","Type":"ContainerStarted","Data":"59c1e51a5c6c67a9c01be15d66086197d7a8a8db044d302922659bd5cb423904"}
Jul 23 13:18:24.046631 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.046610    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:18:24.046982 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.046963    2581 scope.go:117] "RemoveContainer" containerID="b2b4c5a394b9856a03c3f39ed5e6791521d963d769dfab745b66ed9d9d6bb0a6"
Jul 23 13:18:24.047162 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:24.047144    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-67r7j_openshift-console-operator(29ad2808-523c-4f70-b446-61fd56da3bdd)\"" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" podUID="29ad2808-523c-4f70-b446-61fd56da3bdd"
Jul 23 13:18:24.047759 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.047738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p" event={"ID":"18e8232e-5e5b-47d2-9c68-509ae88cf59d","Type":"ContainerStarted","Data":"c246f2fbf05962c983e1a67012beac011fa13147bad139b831ad3a57ff1391bd"}
Jul 23 13:18:24.072508 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.072459    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zd5lz" podStartSLOduration=9.173033019 podStartE2EDuration="48.072445542s" totalImagesPullingTime="38.899412523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:24.07035676 +0000 UTC m=+47.743222201" watchObservedRunningTime="2026-07-23 13:18:24.072445542 +0000 UTC m=+47.745310983"
Jul 23 13:18:24.334438 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.334366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:24.334650 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:24.334482    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:18:24.334746 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:24.334719    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:26.334700701 +0000 UTC m=+50.007566140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : configmap "kube-rbac-proxy" not found
Jul 23 13:18:24.334804 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.334777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:24.334959 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:24.334940    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:24.335034 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:24.335009    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:26.334992297 +0000 UTC m=+50.007857718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:24.507002 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.506980    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r7tsz_27b8ae6a-bf71-44c1-a92c-e7ddc36d0496/node-ca/0.log"
Jul 23 13:18:24.908758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:24.908636    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lp8gs_0270273c-d91f-4785-8293-e2c593a1219c/serve-healthcheck-canary/0.log"
Jul 23 13:18:26.055859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:26.055824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p" event={"ID":"18e8232e-5e5b-47d2-9c68-509ae88cf59d","Type":"ContainerStarted","Data":"c854b82b12246c59f66d4305d9635c1aa5aac5d324cd63070e22714712719fde"}
Jul 23 13:18:26.056365 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:26.055875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p" event={"ID":"18e8232e-5e5b-47d2-9c68-509ae88cf59d","Type":"ContainerStarted","Data":"232a23d04c63e9832719b028758678ecf42a1703c004651689436e2ad096fa38"}
Jul 23 13:18:26.074763 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:26.074722    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-b475p" podStartSLOduration=1.937106802 podStartE2EDuration="4.074707686s" totalImagesPullingTime="2.137600884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:26.073551532 +0000 UTC m=+49.746416983" watchObservedRunningTime="2026-07-23 13:18:26.074707686 +0000 UTC m=+49.747573127"
Jul 23 13:18:26.352166 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:26.352079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:26.352307 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:26.352186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:26.352307 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:26.352195    2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 13:18:26.352307 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:26.352258    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:30.352242264 +0000 UTC m=+54.025107683 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : configmap "kube-rbac-proxy" not found
Jul 23 13:18:26.352307 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:26.352276    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:26.352444 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:26.352315    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:30.352304904 +0000 UTC m=+54.025170324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:27.563250 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.563215    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.563279    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.563314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.563332    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563373    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.563355443 +0000 UTC m=+67.236220862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : configmap references non-existent config key: service-ca.crt
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.563426    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563444    2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563484    2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563497    2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563502    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls podName:30d768cc-a8cf-4ad9-ad86-0d595ab8efbb nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.56348541 +0000 UTC m=+67.236350828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vlxgp" (UID: "30d768cc-a8cf-4ad9-ad86-0d595ab8efbb") : secret "samples-operator-tls" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563444    2581 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563522    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls podName:cd515e9d-3675-4b1b-b5ba-d952156e835f nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.563514687 +0000 UTC m=+67.236380105 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-w2fdv" (UID: "cd515e9d-3675-4b1b-b5ba-d952156e835f") : secret "cluster-monitoring-operator-tls" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563497    2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9d57dd6c4-7w9tt: secret "image-registry-tls" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.563524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563542    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs podName:d68280eb-f909-4ac6-83f1-4226ded01c05 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.563532362 +0000 UTC m=+67.236397807 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs") pod "router-default-6497b8bfb-mvn8k" (UID: "d68280eb-f909-4ac6-83f1-4226ded01c05") : secret "router-metrics-certs-default" not found
Jul 23 13:18:27.563635 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563560    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls podName:6f6af983-9b53-4e8c-8671-51f16e936ef0 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.563550972 +0000 UTC m=+67.236416397 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls") pod "image-registry-9d57dd6c4-7w9tt" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0") : secret "image-registry-tls" not found
Jul 23 13:18:27.564182 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563586    2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 23 13:18:27.564182 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.563620    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert podName:f39f9671-1363-415c-ae2e-3be33b5c2fef nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.563610515 +0000 UTC m=+67.236475936 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-nrx2w" (UID: "f39f9671-1363-415c-ae2e-3be33b5c2fef") : secret "networking-console-plugin-cert" not found
Jul 23 13:18:27.664777 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:27.664748    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:27.664898 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.664880    2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 13:18:27.664936 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:27.664927    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls podName:4d9aea88-b36a-4bd5-81ec-542b5a642c6b nodeName:}" failed. No retries permitted until 2026-07-23 13:18:43.664914468 +0000 UTC m=+67.337779889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls") pod "dns-default-hj9rr" (UID: "4d9aea88-b36a-4bd5-81ec-542b5a642c6b") : secret "dns-default-metrics-tls" not found
Jul 23 13:18:30.386813 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:30.386777    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:30.387285 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:30.386882    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:30.387285 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:30.387029    2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:30.387285 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:30.387114    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls podName:56ce1c97-cbff-49a6-aaa9-273612cdf216 nodeName:}" failed. No retries permitted until 2026-07-23 13:18:38.387078785 +0000 UTC m=+62.059944207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9rssb" (UID: "56ce1c97-cbff-49a6-aaa9-273612cdf216") : secret "insights-runtime-extractor-tls" not found
Jul 23 13:18:30.387398 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:30.387287    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/56ce1c97-cbff-49a6-aaa9-273612cdf216-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:32.069258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:32.069227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:32.069806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:32.069291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:32.069806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:32.069682    2581 scope.go:117] "RemoveContainer" containerID="b2b4c5a394b9856a03c3f39ed5e6791521d963d769dfab745b66ed9d9d6bb0a6"
Jul 23 13:18:32.069926 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:32.069867    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-67r7j_openshift-console-operator(29ad2808-523c-4f70-b446-61fd56da3bdd)\"" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" podUID="29ad2808-523c-4f70-b446-61fd56da3bdd"
Jul 23 13:18:37.970408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:37.970384    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxhgn"
Jul 23 13:18:38.455779 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:38.455749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:38.458236 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:38.458205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/56ce1c97-cbff-49a6-aaa9-273612cdf216-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rssb\" (UID: \"56ce1c97-cbff-49a6-aaa9-273612cdf216\") " pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:38.483027 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:38.483005    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vwfmr\""
Jul 23 13:18:38.490838 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:38.490822    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9rssb"
Jul 23 13:18:38.614773 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:38.614749    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9rssb"]
Jul 23 13:18:38.617099 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:38.617063    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56ce1c97_cbff_49a6_aaa9_273612cdf216.slice/crio-d44f75892d825612dbe64641ee9915fe76ce1e1503a65a92173ad1ef45e6e93f WatchSource:0}: Error finding container d44f75892d825612dbe64641ee9915fe76ce1e1503a65a92173ad1ef45e6e93f: Status 404 returned error can't find the container with id d44f75892d825612dbe64641ee9915fe76ce1e1503a65a92173ad1ef45e6e93f
Jul 23 13:18:39.100046 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:39.099993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rssb" event={"ID":"56ce1c97-cbff-49a6-aaa9-273612cdf216","Type":"ContainerStarted","Data":"d44f75892d825612dbe64641ee9915fe76ce1e1503a65a92173ad1ef45e6e93f"}
Jul 23 13:18:42.495556 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.495521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:42.498930 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.498910    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 13:18:42.509038 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.508993    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7c202944-4918-447e-b505-4bb6ffb66ac6-original-pull-secret\") pod \"global-pull-secret-syncer-hjt2v\" (UID: \"7c202944-4918-447e-b505-4bb6ffb66ac6\") " pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:42.541841 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.541814    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hjt2v"
Jul 23 13:18:42.596830 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.596803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:42.596951 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.596935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:42.599569 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.599547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv7f9\" (UniqueName: \"kubernetes.io/projected/9e4d6e4a-6e00-4e20-bc24-5a17879fe68f-kube-api-access-pv7f9\") pod \"network-check-target-d7j25\" (UID: \"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f\") " pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:42.600132 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.600116    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 13:18:42.609774 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.609750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86371a3a-c576-448a-8c28-3d148149da2f-metrics-certs\") pod \"network-metrics-daemon-ct4ws\" (UID: \"86371a3a-c576-448a-8c28-3d148149da2f\") " pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:42.829586 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.829516    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4ww68\""
Jul 23 13:18:42.837400 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.837373    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:42.841701 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.841670    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-42dd2\""
Jul 23 13:18:42.846154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:42.846135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ct4ws"
Jul 23 13:18:43.441845 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.441730    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ct4ws"]
Jul 23 13:18:43.444197 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:43.444174    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86371a3a_c576_448a_8c28_3d148149da2f.slice/crio-845b3cba1c7495706a96d1b3553cb90786e00ba07642f09f4012e46b1d2cf7af WatchSource:0}: Error finding container 845b3cba1c7495706a96d1b3553cb90786e00ba07642f09f4012e46b1d2cf7af: Status 404 returned error can't find the container with id 845b3cba1c7495706a96d1b3553cb90786e00ba07642f09f4012e46b1d2cf7af
Jul 23 13:18:43.606753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.606685    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:43.606753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.606725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:43.607237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.606771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:43.607237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.606800    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:43.607237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.606851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:43.607237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.606930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:43.607897 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.607807    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68280eb-f909-4ac6-83f1-4226ded01c05-service-ca-bundle\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:43.609288 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.609265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68280eb-f909-4ac6-83f1-4226ded01c05-metrics-certs\") pod \"router-default-6497b8bfb-mvn8k\" (UID: \"d68280eb-f909-4ac6-83f1-4226ded01c05\") " pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:43.609440 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.609416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/cd515e9d-3675-4b1b-b5ba-d952156e835f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-w2fdv\" (UID: \"cd515e9d-3675-4b1b-b5ba-d952156e835f\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:43.609612 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.609591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"image-registry-9d57dd6c4-7w9tt\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") " pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:43.609781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.609760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/30d768cc-a8cf-4ad9-ad86-0d595ab8efbb-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vlxgp\" (UID: \"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:43.609823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.609808    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f39f9671-1363-415c-ae2e-3be33b5c2fef-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-nrx2w\" (UID: \"f39f9671-1363-415c-ae2e-3be33b5c2fef\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:43.643943 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.643920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hjt2v"]
Jul 23 13:18:43.646110 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.646071    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d7j25"]
Jul 23 13:18:43.647497 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:43.647461    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c202944_4918_447e_b505_4bb6ffb66ac6.slice/crio-8de4fd4e1f779848b7afe7d3fe0de8bd2e9060002ae774c8fe3a729107f48264 WatchSource:0}: Error finding container 8de4fd4e1f779848b7afe7d3fe0de8bd2e9060002ae774c8fe3a729107f48264: Status 404 returned error can't find the container with id 8de4fd4e1f779848b7afe7d3fe0de8bd2e9060002ae774c8fe3a729107f48264
Jul 23 13:18:43.648218 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:43.648194    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4d6e4a_6e00_4e20_bc24_5a17879fe68f.slice/crio-fe8d7e64b58c66c739a3fb6de52eabd4972bb7eb8bc5ade421a81fabd129af03 WatchSource:0}: Error finding container fe8d7e64b58c66c739a3fb6de52eabd4972bb7eb8bc5ade421a81fabd129af03: Status 404 returned error can't find the container with id fe8d7e64b58c66c739a3fb6de52eabd4972bb7eb8bc5ade421a81fabd129af03
Jul 23 13:18:43.707676 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.707654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:43.709608 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.709587    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d9aea88-b36a-4bd5-81ec-542b5a642c6b-metrics-tls\") pod \"dns-default-hj9rr\" (UID: \"4d9aea88-b36a-4bd5-81ec-542b5a642c6b\") " pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:43.806591 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.806566    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-dfd6z\""
Jul 23 13:18:43.813631 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.813611    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"
Jul 23 13:18:43.814323 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.814304    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-58cjb\""
Jul 23 13:18:43.821857 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.821776    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"
Jul 23 13:18:43.833532 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.833505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nt6q9\""
Jul 23 13:18:43.841100 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.841061    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"
Jul 23 13:18:43.846760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.846740    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-psc5v\""
Jul 23 13:18:43.854732 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.854710    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:43.862324 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.862236    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fnsmp\""
Jul 23 13:18:43.870306 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.870239    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:43.901111 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.898290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-m94bd\""
Jul 23 13:18:43.909276 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:43.909203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:44.001317 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.000571    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w"]
Jul 23 13:18:44.015013 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:44.010862    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf39f9671_1363_415c_ae2e_3be33b5c2fef.slice/crio-3ca5efb52ba90ba2f92ae966e70314ed7cd9a2876ede7186370a14970f27f6e5 WatchSource:0}: Error finding container 3ca5efb52ba90ba2f92ae966e70314ed7cd9a2876ede7186370a14970f27f6e5: Status 404 returned error can't find the container with id 3ca5efb52ba90ba2f92ae966e70314ed7cd9a2876ede7186370a14970f27f6e5
Jul 23 13:18:44.019842 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.019817    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv"]
Jul 23 13:18:44.093705 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.093678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6497b8bfb-mvn8k"]
Jul 23 13:18:44.103827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.101240    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp"]
Jul 23 13:18:44.118602 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.118577    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9d57dd6c4-7w9tt"]
Jul 23 13:18:44.121598 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:44.121563    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6af983_9b53_4e8c_8671_51f16e936ef0.slice/crio-bd9fb2e8b5a9cfee04666e5fd79b032e31cbbb9944a9135ed2a60e49e47d9a41 WatchSource:0}: Error finding container bd9fb2e8b5a9cfee04666e5fd79b032e31cbbb9944a9135ed2a60e49e47d9a41: Status 404 returned error can't find the container with id bd9fb2e8b5a9cfee04666e5fd79b032e31cbbb9944a9135ed2a60e49e47d9a41
Jul 23 13:18:44.123946 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.123892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rssb" event={"ID":"56ce1c97-cbff-49a6-aaa9-273612cdf216","Type":"ContainerStarted","Data":"9c2fe9b68bbe18768d8b0517db09d6e3022cbe9a66bedd2f361601154a4db46c"}
Jul 23 13:18:44.126380 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.126351    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6497b8bfb-mvn8k" event={"ID":"d68280eb-f909-4ac6-83f1-4226ded01c05","Type":"ContainerStarted","Data":"1a088c7a272f6a5adbcb35bad452305d30c0d367c039199c1132aab62f0f07ae"}
Jul 23 13:18:44.128075 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.128027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv" event={"ID":"cd515e9d-3675-4b1b-b5ba-d952156e835f","Type":"ContainerStarted","Data":"215291e97c0b1a27d6d5e8a7e471c1b897cc590ae1c60662474a9244e5183e28"}
Jul 23 13:18:44.129666 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.129642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w" event={"ID":"f39f9671-1363-415c-ae2e-3be33b5c2fef","Type":"ContainerStarted","Data":"3ca5efb52ba90ba2f92ae966e70314ed7cd9a2876ede7186370a14970f27f6e5"}
Jul 23 13:18:44.131050 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.130940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ct4ws" event={"ID":"86371a3a-c576-448a-8c28-3d148149da2f","Type":"ContainerStarted","Data":"845b3cba1c7495706a96d1b3553cb90786e00ba07642f09f4012e46b1d2cf7af"}
Jul 23 13:18:44.132136 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.132114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjt2v" event={"ID":"7c202944-4918-447e-b505-4bb6ffb66ac6","Type":"ContainerStarted","Data":"8de4fd4e1f779848b7afe7d3fe0de8bd2e9060002ae774c8fe3a729107f48264"}
Jul 23 13:18:44.133616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.133583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d7j25" event={"ID":"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f","Type":"ContainerStarted","Data":"97818f8e96f81b074f4f1967d19032f0fb43ff943d06768d60b428aa55731d30"}
Jul 23 13:18:44.133711 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.133619    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d7j25" event={"ID":"9e4d6e4a-6e00-4e20-bc24-5a17879fe68f","Type":"ContainerStarted","Data":"fe8d7e64b58c66c739a3fb6de52eabd4972bb7eb8bc5ade421a81fabd129af03"}
Jul 23 13:18:44.133851 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.133833    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:18:44.144755 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.144586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hj9rr"]
Jul 23 13:18:44.152380 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:44.152359    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d9aea88_b36a_4bd5_81ec_542b5a642c6b.slice/crio-328919c7ea80d3a76e71eba1cba6665501eb6e0cc6836a755f1ed74cc3d5ad53 WatchSource:0}: Error finding container 328919c7ea80d3a76e71eba1cba6665501eb6e0cc6836a755f1ed74cc3d5ad53: Status 404 returned error can't find the container with id 328919c7ea80d3a76e71eba1cba6665501eb6e0cc6836a755f1ed74cc3d5ad53
Jul 23 13:18:44.176675 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:44.176631    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d7j25" podStartSLOduration=67.176615138 podStartE2EDuration="1m7.176615138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:44.174841391 +0000 UTC m=+67.847706833" watchObservedRunningTime="2026-07-23 13:18:44.176615138 +0000 UTC m=+67.849480608"
Jul 23 13:18:45.141876 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.141835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6497b8bfb-mvn8k" event={"ID":"d68280eb-f909-4ac6-83f1-4226ded01c05","Type":"ContainerStarted","Data":"7426ecbb1fe82c6e25aed49c8cbae867a47114c20ac7f31b7fae76460aac45a6"}
Jul 23 13:18:45.143844 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.143818    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hj9rr" event={"ID":"4d9aea88-b36a-4bd5-81ec-542b5a642c6b","Type":"ContainerStarted","Data":"328919c7ea80d3a76e71eba1cba6665501eb6e0cc6836a755f1ed74cc3d5ad53"}
Jul 23 13:18:45.147872 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.147851    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp" event={"ID":"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb","Type":"ContainerStarted","Data":"1b1eae75f4cf564cc01d448f8e51d734c69652e307873876166553e0881f467d"}
Jul 23 13:18:45.150290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.150267    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" event={"ID":"6f6af983-9b53-4e8c-8671-51f16e936ef0","Type":"ContainerStarted","Data":"e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9"}
Jul 23 13:18:45.150374 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.150306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" event={"ID":"6f6af983-9b53-4e8c-8671-51f16e936ef0","Type":"ContainerStarted","Data":"bd9fb2e8b5a9cfee04666e5fd79b032e31cbbb9944a9135ed2a60e49e47d9a41"}
Jul 23 13:18:45.150374 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.150332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:18:45.167487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.167430    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6497b8bfb-mvn8k" podStartSLOduration=56.167413863 podStartE2EDuration="56.167413863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:45.166274863 +0000 UTC m=+68.839140303" watchObservedRunningTime="2026-07-23 13:18:45.167413863 +0000 UTC m=+68.840279305"
Jul 23 13:18:45.856138 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.856102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:45.859035 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.859010    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:45.882490 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:45.882405    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" podStartSLOduration=68.882385363 podStartE2EDuration="1m8.882385363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:45.193316659 +0000 UTC m=+68.866182102" watchObservedRunningTime="2026-07-23 13:18:45.882385363 +0000 UTC m=+69.555250804"
Jul 23 13:18:46.154208 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:46.154174    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:46.155761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:46.155543    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6497b8bfb-mvn8k"
Jul 23 13:18:46.813786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:46.813749    2581 scope.go:117] "RemoveContainer" containerID="b2b4c5a394b9856a03c3f39ed5e6791521d963d769dfab745b66ed9d9d6bb0a6"
Jul 23 13:18:52.179636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.179588    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:18:52.180049 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.179690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" event={"ID":"29ad2808-523c-4f70-b446-61fd56da3bdd","Type":"ContainerStarted","Data":"63f89c8258578c3419f9f9104c770a81c76adf08af0d60173662b5e24b5141f7"}
Jul 23 13:18:52.180172 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.180153    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:52.199454 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.199413    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-67r7j" podStartSLOduration=45.214984777 podStartE2EDuration="54.199400428s" totalImagesPullingTime="8.984415651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:52.198673798 +0000 UTC m=+75.871539239" watchObservedRunningTime="2026-07-23 13:18:52.199400428 +0000 UTC m=+75.872265847"
Jul 23 13:18:52.319336 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.319302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-67r7j"
Jul 23 13:18:52.526154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.526049    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-hzmmj"]
Jul 23 13:18:52.542612 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.542581    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:18:52.543711 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.543683    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hzmmj"]
Jul 23 13:18:52.547554 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.547534    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 13:18:52.547815 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.547798    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 13:18:52.548013 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.547986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bsmh5\""
Jul 23 13:18:52.685966 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.685935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7v72\" (UniqueName: \"kubernetes.io/projected/72d23988-f810-49a8-8870-c3860712d771-kube-api-access-n7v72\") pod \"downloads-5bc67dcd46-hzmmj\" (UID: \"72d23988-f810-49a8-8870-c3860712d771\") " pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:18:52.786640 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.786570    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7v72\" (UniqueName: \"kubernetes.io/projected/72d23988-f810-49a8-8870-c3860712d771-kube-api-access-n7v72\") pod \"downloads-5bc67dcd46-hzmmj\" (UID: \"72d23988-f810-49a8-8870-c3860712d771\") " pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:18:52.801900 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.801872    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7v72\" (UniqueName: \"kubernetes.io/projected/72d23988-f810-49a8-8870-c3860712d771-kube-api-access-n7v72\") pod \"downloads-5bc67dcd46-hzmmj\" (UID: \"72d23988-f810-49a8-8870-c3860712d771\") " pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:18:52.856304 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:52.856276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:18:53.261836 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.261808    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hzmmj"]
Jul 23 13:18:53.267052 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:53.266792    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d23988_f810_49a8_8870_c3860712d771.slice/crio-e450fa6ffaa12bc5e6ff8b3227e8ea4ad4318f0319cacafab1fbba8e991cde6a WatchSource:0}: Error finding container e450fa6ffaa12bc5e6ff8b3227e8ea4ad4318f0319cacafab1fbba8e991cde6a: Status 404 returned error can't find the container with id e450fa6ffaa12bc5e6ff8b3227e8ea4ad4318f0319cacafab1fbba8e991cde6a
Jul 23 13:18:53.805778 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.804669    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"]
Jul 23 13:18:53.827456 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.827389    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"]
Jul 23 13:18:53.827603 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.827530    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:53.831579 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.831554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dq8cv\""
Jul 23 13:18:53.831722 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.831554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 13:18:53.999760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:53.999722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4861894d-b3d4-499b-8668-5319459f5a01-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7kj9w\" (UID: \"4861894d-b3d4-499b-8668-5319459f5a01\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:54.101229 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.101138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4861894d-b3d4-499b-8668-5319459f5a01-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7kj9w\" (UID: \"4861894d-b3d4-499b-8668-5319459f5a01\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:54.106549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.106515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4861894d-b3d4-499b-8668-5319459f5a01-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-7kj9w\" (UID: \"4861894d-b3d4-499b-8668-5319459f5a01\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:54.139319 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.139290    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:54.201602 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.200802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w" event={"ID":"f39f9671-1363-415c-ae2e-3be33b5c2fef","Type":"ContainerStarted","Data":"df20779116ccc7882293fc9790e14fcf8de9c508e200c282a9cf4bca53c6e673"}
Jul 23 13:18:54.204274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.204241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ct4ws" event={"ID":"86371a3a-c576-448a-8c28-3d148149da2f","Type":"ContainerStarted","Data":"91017da00b78c21afb4e99712bc224eedd3e08445c5f038de76787b3a3159dd1"}
Jul 23 13:18:54.204428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.204302    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ct4ws" event={"ID":"86371a3a-c576-448a-8c28-3d148149da2f","Type":"ContainerStarted","Data":"228d16b3026a259dbc18daede40cf95a43f98d9c54d67b5b1234a07c7eeddd11"}
Jul 23 13:18:54.206870 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.206345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hj9rr" event={"ID":"4d9aea88-b36a-4bd5-81ec-542b5a642c6b","Type":"ContainerStarted","Data":"8bd51d89ad3aa64103b2bb1cceee45c96d265e1282ad9db68f55bff2eeec3b3d"}
Jul 23 13:18:54.206870 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.206394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hj9rr" event={"ID":"4d9aea88-b36a-4bd5-81ec-542b5a642c6b","Type":"ContainerStarted","Data":"3a0467ee54d51f3a1c22585dadec0fc073c8d179dfcd61a12f70bf3e4244113d"}
Jul 23 13:18:54.206870 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.206746    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:18:54.208756 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.208718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp" event={"ID":"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb","Type":"ContainerStarted","Data":"b10bd5164044414870ff4ff74c26784132ec6163e5a125b255ca6282c45950e5"}
Jul 23 13:18:54.208847 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.208769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp" event={"ID":"30d768cc-a8cf-4ad9-ad86-0d595ab8efbb","Type":"ContainerStarted","Data":"1a368b0c3d9180bb99efaee21a656f2a45eac23b4392d2b7f703e364bbd4d125"}
Jul 23 13:18:54.211013 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.210978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rssb" event={"ID":"56ce1c97-cbff-49a6-aaa9-273612cdf216","Type":"ContainerStarted","Data":"4fc678ec39dffbf49c33b77463448b89038d66a050b4b9b5daa817b03ed20aab"}
Jul 23 13:18:54.212546 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.212522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv" event={"ID":"cd515e9d-3675-4b1b-b5ba-d952156e835f","Type":"ContainerStarted","Data":"70ae8d626d50159fbd3f7f2cf0b3e477ba969b3cebb63f3a0323f8a0014c42c1"}
Jul 23 13:18:54.214723 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.214395    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hjt2v" event={"ID":"7c202944-4918-447e-b505-4bb6ffb66ac6","Type":"ContainerStarted","Data":"7382b98a05ae8ac7230e0884605695733908fdba00fe13d533051fccccb2d268"}
Jul 23 13:18:54.217157 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.217138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hzmmj" event={"ID":"72d23988-f810-49a8-8870-c3860712d771","Type":"ContainerStarted","Data":"e450fa6ffaa12bc5e6ff8b3227e8ea4ad4318f0319cacafab1fbba8e991cde6a"}
Jul 23 13:18:54.221109 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.221051    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-nrx2w" podStartSLOduration=38.129113298 podStartE2EDuration="47.221033286s" totalImagesPullingTime="9.091919988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:54.219930517 +0000 UTC m=+77.892795959" watchObservedRunningTime="2026-07-23 13:18:54.221033286 +0000 UTC m=+77.893898729"
Jul 23 13:18:54.261543 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.261482    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-w2fdv" podStartSLOduration=56.575407259 podStartE2EDuration="1m5.261456285s" totalImagesPullingTime="8.686049026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:54.238158845 +0000 UTC m=+77.911024287" watchObservedRunningTime="2026-07-23 13:18:54.261456285 +0000 UTC m=+77.934321728"
Jul 23 13:18:54.262723 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.262677    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ct4ws" podStartSLOduration=67.987216539 podStartE2EDuration="1m17.262662102s" totalImagesPullingTime="9.275445563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:54.261625958 +0000 UTC m=+77.934491389" watchObservedRunningTime="2026-07-23 13:18:54.262662102 +0000 UTC m=+77.935527544"
Jul 23 13:18:54.283971 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.283909    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hjt2v" podStartSLOduration=68.799770531 podStartE2EDuration="1m17.283887542s" totalImagesPullingTime="8.484117011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:17:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:54.283466477 +0000 UTC m=+77.956331917" watchObservedRunningTime="2026-07-23 13:18:54.283887542 +0000 UTC m=+77.956752984"
Jul 23 13:18:54.311148 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.310993    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vlxgp" podStartSLOduration=46.412761624 podStartE2EDuration="55.310981683s" totalImagesPullingTime="8.898220059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:17:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:54.310260799 +0000 UTC m=+77.983126241" watchObservedRunningTime="2026-07-23 13:18:54.310981683 +0000 UTC m=+77.983847132"
Jul 23 13:18:54.334014 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.333955    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hj9rr" podStartSLOduration=34.37814194 podStartE2EDuration="43.333933315s" totalImagesPullingTime="8.955791375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:54.331796505 +0000 UTC m=+78.004661947" watchObservedRunningTime="2026-07-23 13:18:54.333933315 +0000 UTC m=+78.006798761"
Jul 23 13:18:54.542237 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:54.542201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"]
Jul 23 13:18:54.546735 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:54.546689    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4861894d_b3d4_499b_8668_5319459f5a01.slice/crio-12dd14f744556c65d37117ea37e5930c42581a6f19d24f7a852edd8a13d0b4c9 WatchSource:0}: Error finding container 12dd14f744556c65d37117ea37e5930c42581a6f19d24f7a852edd8a13d0b4c9: Status 404 returned error can't find the container with id 12dd14f744556c65d37117ea37e5930c42581a6f19d24f7a852edd8a13d0b4c9
Jul 23 13:18:55.229962 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:55.229923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w" event={"ID":"4861894d-b3d4-499b-8668-5319459f5a01","Type":"ContainerStarted","Data":"12dd14f744556c65d37117ea37e5930c42581a6f19d24f7a852edd8a13d0b4c9"}
Jul 23 13:18:58.246456 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.246413    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rssb" event={"ID":"56ce1c97-cbff-49a6-aaa9-273612cdf216","Type":"ContainerStarted","Data":"ab59987cd140a03538b970fc30f1e1cae37e43f5801d9da743cc30b9956d18a4"}
Jul 23 13:18:58.248388 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.248362    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w" event={"ID":"4861894d-b3d4-499b-8668-5319459f5a01","Type":"ContainerStarted","Data":"ecdf94ea35480e5bd812c4345bd4dee44b0d0b0e42a6eb28a9e5fad774c5b944"}
Jul 23 13:18:58.248587 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.248573    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:58.254597 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.254571    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w"
Jul 23 13:18:58.267978 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.267928    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9rssb" podStartSLOduration=17.428509926 podStartE2EDuration="36.267909042s" totalImagesPullingTime="18.839399116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 13:18:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:58.265195997 +0000 UTC m=+81.938061438" watchObservedRunningTime="2026-07-23 13:18:58.267909042 +0000 UTC m=+81.940774484"
Jul 23 13:18:58.281739 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.281699    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-7kj9w" podStartSLOduration=2.109385509 podStartE2EDuration="5.281685913s" totalImagesPullingTime="3.172300404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:18:58.281251805 +0000 UTC m=+81.954117244" watchObservedRunningTime="2026-07-23 13:18:58.281685913 +0000 UTC m=+81.954551354"
Jul 23 13:18:58.867132 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.867075    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5x296"]
Jul 23 13:18:58.869673 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.869647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:58.872666 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.872633    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 13:18:58.874047 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.874021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 13:18:58.874174 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.874059    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 13:18:58.874289 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.874270    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-pd9rf\""
Jul 23 13:18:58.885698 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:58.885663    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5x296"]
Jul 23 13:18:59.047781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.047744    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4371828-48c3-4378-952b-3c31f92a7c3e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.047933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.047793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.047933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.047875    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.047933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.047931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmfr4\" (UniqueName: \"kubernetes.io/projected/e4371828-48c3-4378-952b-3c31f92a7c3e-kube-api-access-tmfr4\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.148835 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.148803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmfr4\" (UniqueName: \"kubernetes.io/projected/e4371828-48c3-4378-952b-3c31f92a7c3e-kube-api-access-tmfr4\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.149002 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.148847    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4371828-48c3-4378-952b-3c31f92a7c3e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.149002 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.148896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.149002 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.148940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.149225 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:59.149136    2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 23 13:18:59.149225 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:18:59.149225    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-tls podName:e4371828-48c3-4378-952b-3c31f92a7c3e nodeName:}" failed. No retries permitted until 2026-07-23 13:18:59.649204343 +0000 UTC m=+83.322069778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-tls") pod "prometheus-operator-5945b5cfd-5x296" (UID: "e4371828-48c3-4378-952b-3c31f92a7c3e") : secret "prometheus-operator-tls" not found
Jul 23 13:18:59.149651 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.149628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4371828-48c3-4378-952b-3c31f92a7c3e-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.151820 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.151797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.159717 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.159695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmfr4\" (UniqueName: \"kubernetes.io/projected/e4371828-48c3-4378-952b-3c31f92a7c3e-kube-api-access-tmfr4\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.652430 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.652390    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.655309 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.655285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e4371828-48c3-4378-952b-3c31f92a7c3e-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-5x296\" (UID: \"e4371828-48c3-4378-952b-3c31f92a7c3e\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.781009 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.780977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296"
Jul 23 13:18:59.935787 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:18:59.935568    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-5x296"]
Jul 23 13:18:59.938702 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:18:59.938668    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4371828_48c3_4378_952b_3c31f92a7c3e.slice/crio-4964b7ee3776c4df3f6f68506dd001db82dd34d46517500f8435da70e0aa30f3 WatchSource:0}: Error finding container 4964b7ee3776c4df3f6f68506dd001db82dd34d46517500f8435da70e0aa30f3: Status 404 returned error can't find the container with id 4964b7ee3776c4df3f6f68506dd001db82dd34d46517500f8435da70e0aa30f3
Jul 23 13:19:00.258151 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:00.258042    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296" event={"ID":"e4371828-48c3-4378-952b-3c31f92a7c3e","Type":"ContainerStarted","Data":"4964b7ee3776c4df3f6f68506dd001db82dd34d46517500f8435da70e0aa30f3"}
Jul 23 13:19:01.849779 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.849748    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fb98fddf7-586qf"]
Jul 23 13:19:01.852751 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.852726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.857939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.857425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 13:19:01.857939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.857461    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 13:19:01.857939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.857517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q4mmp\""
Jul 23 13:19:01.857939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.857535    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 13:19:01.857939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.857461    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 13:19:01.857939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.857764    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 13:19:01.868041 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.868018    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb98fddf7-586qf"]
Jul 23 13:19:01.870746 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.870723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-service-ca\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.870879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.870773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-oauth-config\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.870879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.870856    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-serving-cert\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.870990 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.870896    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlp94\" (UniqueName: \"kubernetes.io/projected/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-kube-api-access-dlp94\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.870990 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.870925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-config\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.870990 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.870954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-oauth-serving-cert\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.971376 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.971337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-service-ca\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.971580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.971388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-oauth-config\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.971580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.971427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-serving-cert\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.971580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.971453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlp94\" (UniqueName: \"kubernetes.io/projected/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-kube-api-access-dlp94\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.971580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.971476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-config\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.971580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.971503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-oauth-serving-cert\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.972267 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.972219    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-service-ca\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.972267 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.972216    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-oauth-serving-cert\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.972447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.972265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-config\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.974505 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.974480    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-oauth-config\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.974621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.974532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-serving-cert\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:01.986397 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:01.986361    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlp94\" (UniqueName: \"kubernetes.io/projected/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-kube-api-access-dlp94\") pod \"console-fb98fddf7-586qf\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") " pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:02.164006 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:02.163961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:02.305377 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:02.305353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fb98fddf7-586qf"]
Jul 23 13:19:02.308124 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:19:02.308080    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a651e94_2f1c_41b7_89e1_aac4f1c06eb1.slice/crio-8495c6983a8a9226baeaaa71756dbb847a33c849e86d6452aa864ae6f014eb6d WatchSource:0}: Error finding container 8495c6983a8a9226baeaaa71756dbb847a33c849e86d6452aa864ae6f014eb6d: Status 404 returned error can't find the container with id 8495c6983a8a9226baeaaa71756dbb847a33c849e86d6452aa864ae6f014eb6d
Jul 23 13:19:03.280139 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:03.280025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296" event={"ID":"e4371828-48c3-4378-952b-3c31f92a7c3e","Type":"ContainerStarted","Data":"5c959b28f64b616f3c710205b4298ab7dd6c6313a8d78ce874385347f8fd19e4"}
Jul 23 13:19:03.281319 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:03.280678    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296" event={"ID":"e4371828-48c3-4378-952b-3c31f92a7c3e","Type":"ContainerStarted","Data":"9a485a496ec26577da03e5bd93d1bc4bb52ec6691264cd54a3573fd073221f19"}
Jul 23 13:19:03.282240 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:03.282191    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb98fddf7-586qf" event={"ID":"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1","Type":"ContainerStarted","Data":"8495c6983a8a9226baeaaa71756dbb847a33c849e86d6452aa864ae6f014eb6d"}
Jul 23 13:19:03.307656 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:03.307140    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-5x296" podStartSLOduration=2.216935592 podStartE2EDuration="5.307120795s" totalImagesPullingTime="3.090185203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:03.305383169 +0000 UTC m=+86.978248611" watchObservedRunningTime="2026-07-23 13:19:03.307120795 +0000 UTC m=+86.979986237"
Jul 23 13:19:03.878300 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:03.878261    2581 patch_prober.go:28] interesting pod/image-registry-9d57dd6c4-7w9tt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 23 13:19:03.878488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:03.878326    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" podUID="6f6af983-9b53-4e8c-8671-51f16e936ef0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 13:19:04.233249 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:04.233168    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hj9rr"
Jul 23 13:19:05.255017 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.254985    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"]
Jul 23 13:19:05.257820 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.257790    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.260906 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.260880    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 13:19:05.261037 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.260963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ch89g\""
Jul 23 13:19:05.261175 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.261154    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 13:19:05.272998 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.272972    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"]
Jul 23 13:19:05.277397 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.277044    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"]
Jul 23 13:19:05.279672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.279647    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.282724 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.282682    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 23 13:19:05.283072 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.283053    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zm6fx\""
Jul 23 13:19:05.283190 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.283068    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 23 13:19:05.283241 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.283222    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 23 13:19:05.294900 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.294880    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcxdx"]
Jul 23 13:19:05.297011 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.296973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.297134 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297019    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9ca1b46-f389-4385-9468-5b703a0042bb-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.297134 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297053    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.297134 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9ca1b46-f389-4385-9468-5b703a0042bb-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.297356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.297356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/100feeaf-6229-47d5-8217-56755f476427-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.297356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297248    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np4m6\" (UniqueName: \"kubernetes.io/projected/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-api-access-np4m6\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.297356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297285    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.297356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297322    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh6lh\" (UniqueName: \"kubernetes.io/projected/100feeaf-6229-47d5-8217-56755f476427-kube-api-access-zh6lh\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.297599 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.297599 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297426    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"]
Jul 23 13:19:05.297599 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.297547    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.300800 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.300780    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 13:19:05.300955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.300849    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v5kmg\""
Jul 23 13:19:05.301217 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.301195    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 13:19:05.301358 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.301340    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 13:19:05.398201 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-root\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/100feeaf-6229-47d5-8217-56755f476427-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.398362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398234    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np4m6\" (UniqueName: \"kubernetes.io/projected/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-api-access-np4m6\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.398362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-tls\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398305    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-sys\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78m7l\" (UniqueName: \"kubernetes.io/projected/a7503433-f2c4-43a0-a126-c08476fc9190-kube-api-access-78m7l\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh6lh\" (UniqueName: \"kubernetes.io/projected/100feeaf-6229-47d5-8217-56755f476427-kube-api-access-zh6lh\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398496    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398526    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-wtmp\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398569    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398598    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-textfile\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7503433-f2c4-43a0-a126-c08476fc9190-metrics-client-ca\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9ca1b46-f389-4385-9468-5b703a0042bb-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398726    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398761    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9ca1b46-f389-4385-9468-5b703a0042bb-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.398801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.398949 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:05.398928    2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 23 13:19:05.399325 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:05.399007    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-tls podName:100feeaf-6229-47d5-8217-56755f476427 nodeName:}" failed. No retries permitted until 2026-07-23 13:19:05.898986947 +0000 UTC m=+89.571852365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-gg67q" (UID: "100feeaf-6229-47d5-8217-56755f476427") : secret "openshift-state-metrics-tls" not found
Jul 23 13:19:05.399325 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:05.399140    2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 23 13:19:05.399325 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:05.399209    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-tls podName:c9ca1b46-f389-4385-9468-5b703a0042bb nodeName:}" failed. No retries permitted until 2026-07-23 13:19:05.899190206 +0000 UTC m=+89.572055638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-sr5bw" (UID: "c9ca1b46-f389-4385-9468-5b703a0042bb") : secret "kube-state-metrics-tls" not found
Jul 23 13:19:05.399325 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.399140    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/100feeaf-6229-47d5-8217-56755f476427-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.399549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.399415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c9ca1b46-f389-4385-9468-5b703a0042bb-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.399549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.399479    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.399549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.399503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c9ca1b46-f389-4385-9468-5b703a0042bb-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.401137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.401111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.401734 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.401712    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.408512 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.408487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np4m6\" (UniqueName: \"kubernetes.io/projected/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-api-access-np4m6\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.409338 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.409318    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh6lh\" (UniqueName: \"kubernetes.io/projected/100feeaf-6229-47d5-8217-56755f476427-kube-api-access-zh6lh\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.499926 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.499878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500120 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.499992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-wtmp\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500120 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500120 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-textfile\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7503433-f2c4-43a0-a126-c08476fc9190-metrics-client-ca\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-root\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-wtmp\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-tls\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-sys\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78m7l\" (UniqueName: \"kubernetes.io/projected/a7503433-f2c4-43a0-a126-c08476fc9190-kube-api-access-78m7l\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-root\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a7503433-f2c4-43a0-a126-c08476fc9190-sys\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.500670 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:05.500519    2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 13:19:05.500670 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:05.500574    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-tls podName:a7503433-f2c4-43a0-a126-c08476fc9190 nodeName:}" failed. No retries permitted until 2026-07-23 13:19:06.000555337 +0000 UTC m=+89.673420780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-tls") pod "node-exporter-kcxdx" (UID: "a7503433-f2c4-43a0-a126-c08476fc9190") : secret "node-exporter-tls" not found
Jul 23 13:19:05.501012 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.500987    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-textfile\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.501316 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.501295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7503433-f2c4-43a0-a126-c08476fc9190-metrics-client-ca\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.501420 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.501358    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.502723 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.502653    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.513752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.513698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78m7l\" (UniqueName: \"kubernetes.io/projected/a7503433-f2c4-43a0-a126-c08476fc9190-kube-api-access-78m7l\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:05.904410 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.904375    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.904587 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.904430    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:05.907253 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.907229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c9ca1b46-f389-4385-9468-5b703a0042bb-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-sr5bw\" (UID: \"c9ca1b46-f389-4385-9468-5b703a0042bb\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:05.907386 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:05.907368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/100feeaf-6229-47d5-8217-56755f476427-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-gg67q\" (UID: \"100feeaf-6229-47d5-8217-56755f476427\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:06.005798 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.005765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-tls\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:06.008344 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.008320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a7503433-f2c4-43a0-a126-c08476fc9190-node-exporter-tls\") pod \"node-exporter-kcxdx\" (UID: \"a7503433-f2c4-43a0-a126-c08476fc9190\") " pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:06.160455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.160372    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:19:06.169321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.169295    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"
Jul 23 13:19:06.190685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.190661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"
Jul 23 13:19:06.208303 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.208278    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcxdx"
Jul 23 13:19:06.373832 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.373801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 13:19:06.378842 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.378818    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.385916    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.385980    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386025    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386175    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386249    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386261    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kbn4z\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386303    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386373    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386387    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 13:19:06.386515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.386425    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 13:19:06.411549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411483    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-web-config\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411717 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411576    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-config-out\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411717 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411717 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411717 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411682    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411758    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411828    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411843    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.411924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411862    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88xp\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-kube-api-access-j88xp\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.412172 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.411929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.422634 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.422610    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 13:19:06.513003 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.512967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88xp\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-kube-api-access-j88xp\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-web-config\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-config-out\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513219 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513247    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513348    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.513746 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:06.513538    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle podName:fe4f0344-f722-44b2-ad16-df11a59f9989 nodeName:}" failed. No retries permitted until 2026-07-23 13:19:07.013515217 +0000 UTC m=+90.686380636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989") : configmap references non-existent config key: ca-bundle.crt
Jul 23 13:19:06.513886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.513835    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.514125 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.514067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.515877 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:06.515783    2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 23 13:19:06.515877 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:06.515849    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls podName:fe4f0344-f722-44b2-ad16-df11a59f9989 nodeName:}" failed. No retries permitted until 2026-07-23 13:19:07.015826271 +0000 UTC m=+90.688691710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989") : secret "alertmanager-main-tls" not found
Jul 23 13:19:06.517038 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.516998    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-config-volume\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.517934 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.517914    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.518174 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.518139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.518433 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.518416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-config-out\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.518629 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.518608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-web-config\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.519363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.519340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.519521 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.519502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.520507 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.520453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:06.523393 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:06.523373    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88xp\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-kube-api-access-j88xp\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:07.018920 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:07.018885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:07.019157 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:07.018937    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:07.019759 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:07.019728    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:07.021889 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:07.021862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:07.291663 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:07.291582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:19:08.376749 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.376715    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"]
Jul 23 13:19:08.462442 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.462402    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"]
Jul 23 13:19:08.462607 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.462590    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.466290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466261    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 23 13:19:08.466290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466283    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 23 13:19:08.466576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466336    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 23 13:19:08.466576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466529    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cdbfc7mjbq1n6\""
Jul 23 13:19:08.466576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466553    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 23 13:19:08.466771 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466755    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 23 13:19:08.466821 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.466795    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-bbhv8\""
Jul 23 13:19:08.534023 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.533979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/278ee5c2-ad41-45d7-86bd-262c12d42aac-metrics-client-ca\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534195 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534033    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534195 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz59t\" (UniqueName: \"kubernetes.io/projected/278ee5c2-ad41-45d7-86bd-262c12d42aac-kube-api-access-gz59t\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534195 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-tls\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534195 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-grpc-tls\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534251    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.534422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.534294    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635355 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz59t\" (UniqueName: \"kubernetes.io/projected/278ee5c2-ad41-45d7-86bd-262c12d42aac-kube-api-access-gz59t\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635518 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635358    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-tls\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635518 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635518 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-grpc-tls\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635518 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635518 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635533    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/278ee5c2-ad41-45d7-86bd-262c12d42aac-metrics-client-ca\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.635753 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.635572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.636614 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.636563    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/278ee5c2-ad41-45d7-86bd-262c12d42aac-metrics-client-ca\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.639501 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.639066    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.639501 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.639468    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.639689 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.639644    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.640044 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.640028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-grpc-tls\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.641060 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.641039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.641536 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.641512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/278ee5c2-ad41-45d7-86bd-262c12d42aac-secret-thanos-querier-tls\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.645774 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.645752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz59t\" (UniqueName: \"kubernetes.io/projected/278ee5c2-ad41-45d7-86bd-262c12d42aac-kube-api-access-gz59t\") pod \"thanos-querier-85d6cb86c9-cgwf5\" (UID: \"278ee5c2-ad41-45d7-86bd-262c12d42aac\") " pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:08.775791 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:08.775757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:09.461648 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.461609    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9d57dd6c4-7w9tt"]
Jul 23 13:19:09.588329 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.588293    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7667b4dc47-45d4n"]
Jul 23 13:19:09.614715 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.614684    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7667b4dc47-45d4n"]
Jul 23 13:19:09.614859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.614789    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.617888 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.617859    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-19dkdeovvqbjt\""
Jul 23 13:19:09.618204 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.618161    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 13:19:09.618280 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.618214    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 13:19:09.618280 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.618247    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 13:19:09.618371 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.618344    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nhqnh\""
Jul 23 13:19:09.618570 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.618549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 13:19:09.645119 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645098    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f2rk\" (UniqueName: \"kubernetes.io/projected/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-kube-api-access-9f2rk\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.645227 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-client-ca-bundle\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.645227 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-secret-metrics-server-client-certs\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.645227 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-audit-log\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.645383 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-secret-metrics-server-tls\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.645383 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-metrics-server-audit-profiles\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.645471 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.645419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.746432 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746357    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-secret-metrics-server-tls\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.746432 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-metrics-server-audit-profiles\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.746725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.746725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f2rk\" (UniqueName: \"kubernetes.io/projected/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-kube-api-access-9f2rk\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.746725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-client-ca-bundle\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.747164 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746905    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-secret-metrics-server-client-certs\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.747164 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.746960    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-audit-log\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.747410 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.747338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.747410 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.747339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-audit-log\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.747858 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.747823    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-metrics-server-audit-profiles\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.749601 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.749554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-secret-metrics-server-tls\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.749730 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.749709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-client-ca-bundle\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.750362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.750341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-secret-metrics-server-client-certs\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.755440 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.755415    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f2rk\" (UniqueName: \"kubernetes.io/projected/bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933-kube-api-access-9f2rk\") pod \"metrics-server-7667b4dc47-45d4n\" (UID: \"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933\") " pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:09.927059 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:09.927024    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:10.024853 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.024766    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"]
Jul 23 13:19:10.057567 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.057542    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"]
Jul 23 13:19:10.057728 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.057637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.060637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.060612    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 13:19:10.060637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.060612    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-7sv7n\""
Jul 23 13:19:10.150851 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.150789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m5m7n\" (UID: \"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.151035 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.150878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlz75\" (UniqueName: \"kubernetes.io/projected/8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8-kube-api-access-zlz75\") pod \"monitoring-plugin-7b7b7bc8bf-m5m7n\" (UID: \"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.252455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.252417    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlz75\" (UniqueName: \"kubernetes.io/projected/8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8-kube-api-access-zlz75\") pod \"monitoring-plugin-7b7b7bc8bf-m5m7n\" (UID: \"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.252624 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.252561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m5m7n\" (UID: \"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.258854 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.258234    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-m5m7n\" (UID: \"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.273765 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.273718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlz75\" (UniqueName: \"kubernetes.io/projected/8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8-kube-api-access-zlz75\") pod \"monitoring-plugin-7b7b7bc8bf-m5m7n\" (UID: \"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:10.368657 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:10.368575    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:11.520196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.520162    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:19:11.565689 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.565652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:19:11.565864 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.565799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.569017 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.568992    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 13:19:11.569714 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569592    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 13:19:11.569714 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569197    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 13:19:11.569714 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569305    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wl8lc\""
Jul 23 13:19:11.569924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569427    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 13:19:11.569924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569263    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 13:19:11.569924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569826    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 13:19:11.570041 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.569927    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 13:19:11.570664 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.570646    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 13:19:11.570777 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.570694    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a4vfjevgf4kg0\""
Jul 23 13:19:11.570965 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.570950    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 13:19:11.571053 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.570964    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 13:19:11.571135 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.571120    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 13:19:11.571228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.571212    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 13:19:11.571304 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.571293    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 13:19:11.573443 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.573409    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667140    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667165    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667230    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64c5v\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-kube-api-access-64c5v\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667427    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667478    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667550    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.667924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.668841 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667613    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.668841 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667634    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.668841 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.668841 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.667718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.768894 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.768860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.768912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.768947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.768965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.768987    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769169    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64c5v\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-kube-api-access-64c5v\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769219    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769276    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769311    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769364    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.769422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769378    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.770026 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.770026 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.769748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.770395 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.770256    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.770395 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.770365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.770628 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.770601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.770975 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.770950    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.772570 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.772536    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.773644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.773320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.774859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.774535    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.777626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.776715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.777626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.777305    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.777626 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.777438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config-out\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.779621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.778064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.779621 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.778341    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.780114 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.779948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.780447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.780406    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.781007 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.780962    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.781007 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.780992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.781711 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.781685    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-web-config\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.781803 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.781788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64c5v\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-kube-api-access-64c5v\") pod \"prometheus-k8s-0\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:11.882415 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:11.882370    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:12.846570 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:19:12.846169    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7503433_f2c4_43a0_a126_c08476fc9190.slice/crio-890e6873eadd6b646a600bcc66b25f7ee91f2e395cdc9bbd922933fcfd72f589 WatchSource:0}: Error finding container 890e6873eadd6b646a600bcc66b25f7ee91f2e395cdc9bbd922933fcfd72f589: Status 404 returned error can't find the container with id 890e6873eadd6b646a600bcc66b25f7ee91f2e395cdc9bbd922933fcfd72f589
Jul 23 13:19:13.122458 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.121121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"]
Jul 23 13:19:13.123628 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:19:13.123600    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278ee5c2_ad41_45d7_86bd_262c12d42aac.slice/crio-7abc44a74470b30b9c867b5d8089e98542e52bd34dd5d791efbf632e2acee606 WatchSource:0}: Error finding container 7abc44a74470b30b9c867b5d8089e98542e52bd34dd5d791efbf632e2acee606: Status 404 returned error can't find the container with id 7abc44a74470b30b9c867b5d8089e98542e52bd34dd5d791efbf632e2acee606
Jul 23 13:19:13.138345 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.138316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-sr5bw"]
Jul 23 13:19:13.158162 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.158136    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"]
Jul 23 13:19:13.160775 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:19:13.160748    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb7c619_0a33_4eb2_8b52_7b2f55dfc5a8.slice/crio-38562fa29ecd2c7f1288993fae4e7f8b61fc21578d0b6a2a8a082000f5ecc72d WatchSource:0}: Error finding container 38562fa29ecd2c7f1288993fae4e7f8b61fc21578d0b6a2a8a082000f5ecc72d: Status 404 returned error can't find the container with id 38562fa29ecd2c7f1288993fae4e7f8b61fc21578d0b6a2a8a082000f5ecc72d
Jul 23 13:19:13.268976 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.268945    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 13:19:13.271490 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:19:13.271459    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe4f0344_f722_44b2_ad16_df11a59f9989.slice/crio-d4885a1af1c66ce69b83870a05f95cf61cd32a674f85799f1c658227f48bd8c0 WatchSource:0}: Error finding container d4885a1af1c66ce69b83870a05f95cf61cd32a674f85799f1c658227f48bd8c0: Status 404 returned error can't find the container with id d4885a1af1c66ce69b83870a05f95cf61cd32a674f85799f1c658227f48bd8c0
Jul 23 13:19:13.330855 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.330775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n" event={"ID":"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8","Type":"ContainerStarted","Data":"38562fa29ecd2c7f1288993fae4e7f8b61fc21578d0b6a2a8a082000f5ecc72d"}
Jul 23 13:19:13.331996 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.331971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxdx" event={"ID":"a7503433-f2c4-43a0-a126-c08476fc9190","Type":"ContainerStarted","Data":"890e6873eadd6b646a600bcc66b25f7ee91f2e395cdc9bbd922933fcfd72f589"}
Jul 23 13:19:13.334333 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.334306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"7abc44a74470b30b9c867b5d8089e98542e52bd34dd5d791efbf632e2acee606"}
Jul 23 13:19:13.335693 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.335663    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw" event={"ID":"c9ca1b46-f389-4385-9468-5b703a0042bb","Type":"ContainerStarted","Data":"ac8d71113a0079f455454816f3e067ee1aca39d6fba376d4bf98ad1c9a3c7d4f"}
Jul 23 13:19:13.336819 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.336789    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"d4885a1af1c66ce69b83870a05f95cf61cd32a674f85799f1c658227f48bd8c0"}
Jul 23 13:19:13.338454 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.338422    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb98fddf7-586qf" event={"ID":"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1","Type":"ContainerStarted","Data":"a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a"}
Jul 23 13:19:13.339898 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.339878    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hzmmj" event={"ID":"72d23988-f810-49a8-8870-c3860712d771","Type":"ContainerStarted","Data":"6e85c1d41fe0d3369e7e98deb842250c9b65dd09672e276e8bf7ad0d300b656f"}
Jul 23 13:19:13.340060 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.340034    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:19:13.341498 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.341476    2581 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-hzmmj container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused" start-of-body=
Jul 23 13:19:13.341586 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.341526    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-hzmmj" podUID="72d23988-f810-49a8-8870-c3860712d771" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.21:8080/\": dial tcp 10.132.0.21:8080: connect: connection refused"
Jul 23 13:19:13.358782 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.358737    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fb98fddf7-586qf" podStartSLOduration=1.834326812 podStartE2EDuration="12.358720679s" totalImagesPullingTime="10.524393867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:13.358339075 +0000 UTC m=+97.031204517" watchObservedRunningTime="2026-07-23 13:19:13.358720679 +0000 UTC m=+97.031586121"
Jul 23 13:19:13.379862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.379811    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-hzmmj" podStartSLOduration=1.791996047 podStartE2EDuration="21.379797036s" totalImagesPullingTime="19.587800989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:13.377707126 +0000 UTC m=+97.050572568" watchObservedRunningTime="2026-07-23 13:19:13.379797036 +0000 UTC m=+97.052662492"
Jul 23 13:19:13.397825 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.397766    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q"]
Jul 23 13:19:13.401520 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.401461    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7667b4dc47-45d4n"]
Jul 23 13:19:13.403623 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:13.403602    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:19:13.413507 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:19:13.406656    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5e1f14_8e26_4ca7_8d80_0b09a0cb8933.slice/crio-80545fef597c0889a9b62408fc7bcdc637a97ba9a4008a4eea7880281e0cd1fb WatchSource:0}: Error finding container 80545fef597c0889a9b62408fc7bcdc637a97ba9a4008a4eea7880281e0cd1fb: Status 404 returned error can't find the container with id 80545fef597c0889a9b62408fc7bcdc637a97ba9a4008a4eea7880281e0cd1fb
Jul 23 13:19:14.352024 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:14.351915    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"024117878ceafc753d9dfa494bcd5e217bf36cd962d9bc661473f9f36f763f97"}
Jul 23 13:19:14.358864 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:14.358779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n" event={"ID":"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933","Type":"ContainerStarted","Data":"80545fef597c0889a9b62408fc7bcdc637a97ba9a4008a4eea7880281e0cd1fb"}
Jul 23 13:19:14.364686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:14.362708    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q" event={"ID":"100feeaf-6229-47d5-8217-56755f476427","Type":"ContainerStarted","Data":"1cf67dfab807d4a2d58082438dd90ba877f6cc7eb6fb313fbffcb2e39113b56f"}
Jul 23 13:19:14.364686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:14.362765    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q" event={"ID":"100feeaf-6229-47d5-8217-56755f476427","Type":"ContainerStarted","Data":"5440a22a75a939489586c368b141c75734f6163bb9bf65565ab075e76e0a7056"}
Jul 23 13:19:14.364686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:14.362792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q" event={"ID":"100feeaf-6229-47d5-8217-56755f476427","Type":"ContainerStarted","Data":"b239b01b6aad60a4ebb7bd019af4e5fe1ad2b3fd716a226d48bb8ceaa9ff6b9d"}
Jul 23 13:19:14.378225 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:14.378207    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-hzmmj"
Jul 23 13:19:15.154032 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:15.153058    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d7j25"
Jul 23 13:19:17.095058 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:17.095022    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb98fddf7-586qf"]
Jul 23 13:19:20.439406 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.439113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n" event={"ID":"bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933","Type":"ContainerStarted","Data":"14924033a8c347deeae80f5a2ca6551387cc1eb249e77ac6fedcc83b15ebbfa7"}
Jul 23 13:19:20.445964 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.445623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n" event={"ID":"8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8","Type":"ContainerStarted","Data":"6189d07ef4493eef4e6d6a00095c32957590b6badccc05be4a4cd4be970abde3"}
Jul 23 13:19:20.446317 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.446255    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:20.449360 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.448807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxdx" event={"ID":"a7503433-f2c4-43a0-a126-c08476fc9190","Type":"ContainerStarted","Data":"2112d59f31a0702b589f29fd929beb51d4a2b54417059f196142339a066b8432"}
Jul 23 13:19:20.452943 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.452907    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n"
Jul 23 13:19:20.455884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.455848    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q" event={"ID":"100feeaf-6229-47d5-8217-56755f476427","Type":"ContainerStarted","Data":"07ca8b2544ea092d395848e84360fab5b7f36a76163120fc6893f4e1286f6876"}
Jul 23 13:19:20.462323 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.462041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"19ff7dd0bf105c28931e2d7da13b9a2a6113b9ffe931ec715e3f893bfb30e240"}
Jul 23 13:19:20.463863 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.463699    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n" podStartSLOduration=5.100607427 podStartE2EDuration="11.463680393s" totalImagesPullingTime="6.363072966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:20.462141486 +0000 UTC m=+104.135006954" watchObservedRunningTime="2026-07-23 13:19:20.463680393 +0000 UTC m=+104.136545833"
Jul 23 13:19:20.465671 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.465588    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw" event={"ID":"c9ca1b46-f389-4385-9468-5b703a0042bb","Type":"ContainerStarted","Data":"c35e6bf3790103886c98a65fb495989043aaf78e217637ccaf93da1cec161803"}
Jul 23 13:19:20.465671 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.465639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw" event={"ID":"c9ca1b46-f389-4385-9468-5b703a0042bb","Type":"ContainerStarted","Data":"12f1875d19145642373890b06f6a7f08e3e0fc80ed4aafd5919ecf3bac0d02d2"}
Jul 23 13:19:20.467908 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.467881    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"99943a420980cea5c4f1ea0f00cf8fc86913c573569e74a8fef48c60db9b988b"}
Jul 23 13:19:20.470907 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.470309    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d"}
Jul 23 13:19:20.490771 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.490700    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-m5m7n" podStartSLOduration=3.878710654 podStartE2EDuration="10.49068109s" totalImagesPullingTime="6.611970436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:20.488688129 +0000 UTC m=+104.161553571" watchObservedRunningTime="2026-07-23 13:19:20.49068109 +0000 UTC m=+104.163546533"
Jul 23 13:19:20.524294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:20.523659    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-gg67q" podStartSLOduration=9.478768195 podStartE2EDuration="15.523623974s" totalImagesPullingTime="6.044855779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:20.522161916 +0000 UTC m=+104.195027350" watchObservedRunningTime="2026-07-23 13:19:20.523623974 +0000 UTC m=+104.196489417"
Jul 23 13:19:21.483939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.483895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"de99456ff9aee4ce92886321bd349deb9b18d43e5383f07d1f24362361cce420"}
Jul 23 13:19:21.484655 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.483972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"223037e0692ef4b67b4113136f1d2932ade57ffc64d72c7a94943b497185c289"}
Jul 23 13:19:21.488672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.488640    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw" event={"ID":"c9ca1b46-f389-4385-9468-5b703a0042bb","Type":"ContainerStarted","Data":"ed93d780abdfdeb791075ce5cbbe1257f9de896341ef4abf649acfb380031b9b"}
Jul 23 13:19:21.491622 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.491493    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="99943a420980cea5c4f1ea0f00cf8fc86913c573569e74a8fef48c60db9b988b" exitCode=0
Jul 23 13:19:21.491622 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.491560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"99943a420980cea5c4f1ea0f00cf8fc86913c573569e74a8fef48c60db9b988b"}
Jul 23 13:19:21.496567 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.496190    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d" exitCode=0
Jul 23 13:19:21.496567 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.496344    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d"}
Jul 23 13:19:21.499717 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.499690    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7503433-f2c4-43a0-a126-c08476fc9190" containerID="2112d59f31a0702b589f29fd929beb51d4a2b54417059f196142339a066b8432" exitCode=0
Jul 23 13:19:21.500778 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.500738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxdx" event={"ID":"a7503433-f2c4-43a0-a126-c08476fc9190","Type":"ContainerDied","Data":"2112d59f31a0702b589f29fd929beb51d4a2b54417059f196142339a066b8432"}
Jul 23 13:19:21.563108 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:21.563039    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-sr5bw" podStartSLOduration=10.93920151 podStartE2EDuration="16.563015436s" totalImagesPullingTime="5.623813926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:21.521970212 +0000 UTC m=+105.194835655" watchObservedRunningTime="2026-07-23 13:19:21.563015436 +0000 UTC m=+105.235880879"
Jul 23 13:19:22.165184 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:22.165144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:22.511822 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:22.511721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxdx" event={"ID":"a7503433-f2c4-43a0-a126-c08476fc9190","Type":"ContainerStarted","Data":"f0bb4e1db0d2b0cef7ec3453f12a6060bb5115fe56549852b54b86d138ff28b4"}
Jul 23 13:19:22.512292 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:22.511834    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcxdx" event={"ID":"a7503433-f2c4-43a0-a126-c08476fc9190","Type":"ContainerStarted","Data":"2ab35ab3d6c817d5eec1cfcdd98fccdb5eea9fdeac7652c2b42664bfcdb753be"}
Jul 23 13:19:22.538993 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:22.537542    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcxdx" podStartSLOduration=11.657064453 podStartE2EDuration="17.537521272s" totalImagesPullingTime="5.70421739s" totalInitContainerRuntime="176.239429ms" isStatefulPod=true podCreationTimestamp="2026-07-23 13:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:22.536017946 +0000 UTC m=+106.208883390" watchObservedRunningTime="2026-07-23 13:19:22.537521272 +0000 UTC m=+106.210386718"
Jul 23 13:19:25.533018 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.532987    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"da7a071221b8542197ca40808c5a16668d39fbbc39719c42bff140fe851a4667"}
Jul 23 13:19:25.533472 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.533109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"18561fdb5f7d785bef3fddf1e67269bac0736d911492ef810a4536ddc72bd546"}
Jul 23 13:19:25.533472 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.533141    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" event={"ID":"278ee5c2-ad41-45d7-86bd-262c12d42aac","Type":"ContainerStarted","Data":"77d417c20d5bbcbe274a3493a164319fe3d365a48cf6f12cf5faedbda26d980c"}
Jul 23 13:19:25.533472 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.533181    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:25.536538 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.536514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"1b6ef65a05e237d0e1eadcb42109ac21dd0c9319529b5b8a9499e0814692a867"}
Jul 23 13:19:25.536667 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.536577    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"f5d0cf4af2c4c9d65e7e30d2f5839013d53bb69785ad13238817365cad481fdc"}
Jul 23 13:19:25.536667 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.536615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"0d149f3851c5de296135428fff80bdf1af5d167eeffe62ca7d9304dfa9e2bd84"}
Jul 23 13:19:25.536667 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.536657    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"e20235b91696d9bed2d1d65dea0f374c900ec0ec6eadcd82f21127a179156db0"}
Jul 23 13:19:25.536805 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.536693    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"f38a198801621d48bc0fa842d294d735ce00927babca1d8a73258c4999150543"}
Jul 23 13:19:25.536805 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.536731    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerStarted","Data":"a29f00276355b054fac575d3c3c4236bd0665a3c01b795baba513d596d796dea"}
Jul 23 13:19:25.539199 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.539180    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5"
Jul 23 13:19:25.540927 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.540907    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d"}
Jul 23 13:19:25.541010 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.540952    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26"}
Jul 23 13:19:25.541010 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.540978    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036"}
Jul 23 13:19:25.541010 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.541004    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18"}
Jul 23 13:19:25.541135 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.541030    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59"}
Jul 23 13:19:25.541135 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.541053    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerStarted","Data":"436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e"}
Jul 23 13:19:25.562404 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.562363    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-85d6cb86c9-cgwf5" podStartSLOduration=6.633289918 podStartE2EDuration="17.562350779s" totalImagesPullingTime="10.929060861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:25.559301142 +0000 UTC m=+109.232166630" watchObservedRunningTime="2026-07-23 13:19:25.562350779 +0000 UTC m=+109.235216219"
Jul 23 13:19:25.620665 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.620619    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.968111426 podStartE2EDuration="14.620602315s" totalImagesPullingTime="10.615096897s" totalInitContainerRuntime="37.393992ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:25.619256 +0000 UTC m=+109.292121468" watchObservedRunningTime="2026-07-23 13:19:25.620602315 +0000 UTC m=+109.293467778"
Jul 23 13:19:25.662853 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:25.662807    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.827790512 podStartE2EDuration="19.662792516s" totalImagesPullingTime="10.787317318s" totalInitContainerRuntime="47.684686ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:19:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:19:25.660004418 +0000 UTC m=+109.332869883" watchObservedRunningTime="2026-07-23 13:19:25.662792516 +0000 UTC m=+109.335657958"
Jul 23 13:19:26.883054 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:26.883023    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:19:29.927674 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:29.927638    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:29.928068 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:29.927941    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:34.490734 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.490689    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" podUID="6f6af983-9b53-4e8c-8671-51f16e936ef0" containerName="registry" containerID="cri-o://e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9" gracePeriod=30
Jul 23 13:19:34.766612 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.766552    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:19:34.913167 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913141    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k6fb\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-kube-api-access-8k6fb\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913314 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913213    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-trusted-ca\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913314 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913245    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-image-registry-private-configuration\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913314 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913276    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-certificates\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913495 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913472    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-installation-pull-secrets\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913561 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6af983-9b53-4e8c-8671-51f16e936ef0-ca-trust-extracted\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913586    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913672 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-bound-sa-token\") pod \"6f6af983-9b53-4e8c-8671-51f16e936ef0\" (UID: \"6f6af983-9b53-4e8c-8671-51f16e936ef0\") "
Jul 23 13:19:34.913738 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913674    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:19:34.913738 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913690    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:19:34.913941 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913922    2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-certificates\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:34.914194 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.913946    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6f6af983-9b53-4e8c-8671-51f16e936ef0-trusted-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:34.915941 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.915918    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:19:34.916128 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.916104    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:19:34.916454 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.916424    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-kube-api-access-8k6fb" (OuterVolumeSpecName: "kube-api-access-8k6fb") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "kube-api-access-8k6fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:19:34.916536 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.916460    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:19:34.916576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.916529    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:19:34.922149 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:34.922128    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f6af983-9b53-4e8c-8671-51f16e936ef0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6f6af983-9b53-4e8c-8671-51f16e936ef0" (UID: "6f6af983-9b53-4e8c-8671-51f16e936ef0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:19:35.014419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.014397    2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-registry-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:35.014419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.014419    2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-bound-sa-token\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:35.014547 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.014427    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k6fb\" (UniqueName: \"kubernetes.io/projected/6f6af983-9b53-4e8c-8671-51f16e936ef0-kube-api-access-8k6fb\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:35.014547 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.014439    2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-image-registry-private-configuration\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:35.014547 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.014449    2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6f6af983-9b53-4e8c-8671-51f16e936ef0-installation-pull-secrets\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:35.014547 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.014457    2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6f6af983-9b53-4e8c-8671-51f16e936ef0-ca-trust-extracted\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:35.592187 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.592154    2581 generic.go:356] "Generic (PLEG): container finished" podID="6f6af983-9b53-4e8c-8671-51f16e936ef0" containerID="e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9" exitCode=0
Jul 23 13:19:35.592633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.592205    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt"
Jul 23 13:19:35.592633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.592237    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" event={"ID":"6f6af983-9b53-4e8c-8671-51f16e936ef0","Type":"ContainerDied","Data":"e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9"}
Jul 23 13:19:35.592633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.592292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-9d57dd6c4-7w9tt" event={"ID":"6f6af983-9b53-4e8c-8671-51f16e936ef0","Type":"ContainerDied","Data":"bd9fb2e8b5a9cfee04666e5fd79b032e31cbbb9944a9135ed2a60e49e47d9a41"}
Jul 23 13:19:35.592633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.592315    2581 scope.go:117] "RemoveContainer" containerID="e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9"
Jul 23 13:19:35.603612 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.603559    2581 scope.go:117] "RemoveContainer" containerID="e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9"
Jul 23 13:19:35.604016 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:35.603990    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9\": container with ID starting with e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9 not found: ID does not exist" containerID="e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9"
Jul 23 13:19:35.604126 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.604022    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9"} err="failed to get container status \"e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9\": rpc error: code = NotFound desc = could not find container \"e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9\": container with ID starting with e5b732f8d1b2c7e2f09b6202748709c1db4c6395ab10715cc548fc7e2ad6ada9 not found: ID does not exist"
Jul 23 13:19:35.614677 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.614656    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9d57dd6c4-7w9tt"]
Jul 23 13:19:35.618455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:35.618436    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9d57dd6c4-7w9tt"]
Jul 23 13:19:36.823394 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:36.823364    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f6af983-9b53-4e8c-8671-51f16e936ef0" path="/var/lib/kubelet/pods/6f6af983-9b53-4e8c-8671-51f16e936ef0/volumes"
Jul 23 13:19:42.127035 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.126967    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fb98fddf7-586qf" podUID="4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" containerName="console" containerID="cri-o://a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a" gracePeriod=15
Jul 23 13:19:42.400832 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.400776    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:42.580137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580108    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-oauth-serving-cert\") pod \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") "
Jul 23 13:19:42.580137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580138    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-config\") pod \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") "
Jul 23 13:19:42.580363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-serving-cert\") pod \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") "
Jul 23 13:19:42.580363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-oauth-config\") pod \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") "
Jul 23 13:19:42.580458 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580377    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlp94\" (UniqueName: \"kubernetes.io/projected/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-kube-api-access-dlp94\") pod \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") "
Jul 23 13:19:42.580458 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-service-ca\") pod \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\" (UID: \"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1\") "
Jul 23 13:19:42.580596 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580557    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-config" (OuterVolumeSpecName: "console-config") pod "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" (UID: "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:19:42.580596 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580569    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" (UID: "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:19:42.580818 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580798    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-oauth-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:42.580889 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580825    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:42.580889 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.580847    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-service-ca" (OuterVolumeSpecName: "service-ca") pod "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" (UID: "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:19:42.582613 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.582590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-kube-api-access-dlp94" (OuterVolumeSpecName: "kube-api-access-dlp94") pod "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" (UID: "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1"). InnerVolumeSpecName "kube-api-access-dlp94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:19:42.582683 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.582612    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" (UID: "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:19:42.582683 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.582648    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" (UID: "4a651e94-2f1c-41b7-89e1-aac4f1c06eb1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:19:42.629689 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.629664    2581 generic.go:356] "Generic (PLEG): container finished" podID="4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" containerID="a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a" exitCode=0
Jul 23 13:19:42.629808 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.629708    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fb98fddf7-586qf"
Jul 23 13:19:42.629808 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.629712    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb98fddf7-586qf" event={"ID":"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1","Type":"ContainerDied","Data":"a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a"}
Jul 23 13:19:42.629808 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.629777    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fb98fddf7-586qf" event={"ID":"4a651e94-2f1c-41b7-89e1-aac4f1c06eb1","Type":"ContainerDied","Data":"8495c6983a8a9226baeaaa71756dbb847a33c849e86d6452aa864ae6f014eb6d"}
Jul 23 13:19:42.629808 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.629799    2581 scope.go:117] "RemoveContainer" containerID="a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a"
Jul 23 13:19:42.638639 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.638623    2581 scope.go:117] "RemoveContainer" containerID="a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a"
Jul 23 13:19:42.638911 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:19:42.638894    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a\": container with ID starting with a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a not found: ID does not exist" containerID="a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a"
Jul 23 13:19:42.638970 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.638920    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a"} err="failed to get container status \"a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a\": rpc error: code = NotFound desc = could not find container \"a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a\": container with ID starting with a8d6aef261b635a7f56951927e85ca90ad5d40b195c2190ebaf9f039055c306a not found: ID does not exist"
Jul 23 13:19:42.651023 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.650974    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fb98fddf7-586qf"]
Jul 23 13:19:42.656489 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.656465    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fb98fddf7-586qf"]
Jul 23 13:19:42.681249 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.681223    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-serving-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:42.681249 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.681246    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-console-oauth-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:42.681371 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.681260    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlp94\" (UniqueName: \"kubernetes.io/projected/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-kube-api-access-dlp94\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:42.681371 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.681275    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:19:42.817466 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:42.817433    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" path="/var/lib/kubelet/pods/4a651e94-2f1c-41b7-89e1-aac4f1c06eb1/volumes"
Jul 23 13:19:47.654480 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:47.654447    2581 generic.go:356] "Generic (PLEG): container finished" podID="03965384-c042-4fc8-b6c4-a6ede7df7d8b" containerID="84408204e1fbc99cb5f02415ee3f67ec142f362d247f17a02de1673e80cb453f" exitCode=0
Jul 23 13:19:47.654882 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:47.654510    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq" event={"ID":"03965384-c042-4fc8-b6c4-a6ede7df7d8b","Type":"ContainerDied","Data":"84408204e1fbc99cb5f02415ee3f67ec142f362d247f17a02de1673e80cb453f"}
Jul 23 13:19:47.654882 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:47.654838    2581 scope.go:117] "RemoveContainer" containerID="84408204e1fbc99cb5f02415ee3f67ec142f362d247f17a02de1673e80cb453f"
Jul 23 13:19:48.661479 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:48.661444    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-wn6xq" event={"ID":"03965384-c042-4fc8-b6c4-a6ede7df7d8b","Type":"ContainerStarted","Data":"128790d245a11c9f9afceb4d2b4c2d884a17f6e5b9057ffbb2adad981d6930fc"}
Jul 23 13:19:49.932564 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:49.932534    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:49.936209 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:49.936189    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7667b4dc47-45d4n"
Jul 23 13:19:52.683408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:52.683375    2581 generic.go:356] "Generic (PLEG): container finished" podID="e8395b87-111d-466e-b079-de2d532879f4" containerID="e6715ccc3b3db2c7465d10eb54c2c74df934dd4e6b3f565db5bebbaf3482fca8" exitCode=0
Jul 23 13:19:52.683808 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:52.683453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch" event={"ID":"e8395b87-111d-466e-b079-de2d532879f4","Type":"ContainerDied","Data":"e6715ccc3b3db2c7465d10eb54c2c74df934dd4e6b3f565db5bebbaf3482fca8"}
Jul 23 13:19:52.683874 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:52.683840    2581 scope.go:117] "RemoveContainer" containerID="e6715ccc3b3db2c7465d10eb54c2c74df934dd4e6b3f565db5bebbaf3482fca8"
Jul 23 13:19:52.684962 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:52.684945    2581 generic.go:356] "Generic (PLEG): container finished" podID="0fa6d26a-1db4-42d8-8d3f-85698faa9e1e" containerID="8754cba175ae31b0714393d039d655fa98ce48cbaa9787c5b87998de0bf88b4a" exitCode=0
Jul 23 13:19:52.685051 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:52.684990    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-szjfl" event={"ID":"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e","Type":"ContainerDied","Data":"8754cba175ae31b0714393d039d655fa98ce48cbaa9787c5b87998de0bf88b4a"}
Jul 23 13:19:52.685925 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:52.685901    2581 scope.go:117] "RemoveContainer" containerID="8754cba175ae31b0714393d039d655fa98ce48cbaa9787c5b87998de0bf88b4a"
Jul 23 13:19:53.691312 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:53.691277    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-9tvch" event={"ID":"e8395b87-111d-466e-b079-de2d532879f4","Type":"ContainerStarted","Data":"a9b71066ca5a4e8c50ac074739af91e655c2cd4db310b511c85c60b3b3ec4d81"}
Jul 23 13:19:53.693125 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:19:53.693077    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-szjfl" event={"ID":"0fa6d26a-1db4-42d8-8d3f-85698faa9e1e","Type":"ContainerStarted","Data":"68a89c50d9e853ef1787c70764e4807bb7e46fa6bccb0cd48e7c9f5a1b2e0f69"}
Jul 23 13:20:11.882779 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:11.882747    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:11.899014 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:11.898992    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:12.816715 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:12.816685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:25.714012 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.713977    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 13:20:25.714485 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.714268    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="alertmanager" containerID="cri-o://a29f00276355b054fac575d3c3c4236bd0665a3c01b795baba513d596d796dea" gracePeriod=120
Jul 23 13:20:25.714485 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.714342    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-metric" containerID="cri-o://f5d0cf4af2c4c9d65e7e30d2f5839013d53bb69785ad13238817365cad481fdc" gracePeriod=120
Jul 23 13:20:25.714485 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.714371    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="prom-label-proxy" containerID="cri-o://1b6ef65a05e237d0e1eadcb42109ac21dd0c9319529b5b8a9499e0814692a867" gracePeriod=120
Jul 23 13:20:25.714485 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.714396    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-web" containerID="cri-o://e20235b91696d9bed2d1d65dea0f374c900ec0ec6eadcd82f21127a179156db0" gracePeriod=120
Jul 23 13:20:25.714485 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.714427    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="config-reloader" containerID="cri-o://f38a198801621d48bc0fa842d294d735ce00927babca1d8a73258c4999150543" gracePeriod=120
Jul 23 13:20:25.714725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.714436    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy" containerID="cri-o://0d149f3851c5de296135428fff80bdf1af5d167eeffe62ca7d9304dfa9e2bd84" gracePeriod=120
Jul 23 13:20:25.858582 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858559    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="1b6ef65a05e237d0e1eadcb42109ac21dd0c9319529b5b8a9499e0814692a867" exitCode=0
Jul 23 13:20:25.858582 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858580    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="0d149f3851c5de296135428fff80bdf1af5d167eeffe62ca7d9304dfa9e2bd84" exitCode=0
Jul 23 13:20:25.858582 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858586    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="f38a198801621d48bc0fa842d294d735ce00927babca1d8a73258c4999150543" exitCode=0
Jul 23 13:20:25.858744 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858592    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="a29f00276355b054fac575d3c3c4236bd0665a3c01b795baba513d596d796dea" exitCode=0
Jul 23 13:20:25.858744 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"1b6ef65a05e237d0e1eadcb42109ac21dd0c9319529b5b8a9499e0814692a867"}
Jul 23 13:20:25.858744 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858698    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"0d149f3851c5de296135428fff80bdf1af5d167eeffe62ca7d9304dfa9e2bd84"}
Jul 23 13:20:25.858744 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858727    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"f38a198801621d48bc0fa842d294d735ce00927babca1d8a73258c4999150543"}
Jul 23 13:20:25.858862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:25.858762    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"a29f00276355b054fac575d3c3c4236bd0665a3c01b795baba513d596d796dea"}
Jul 23 13:20:26.867674 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:26.867647    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="f5d0cf4af2c4c9d65e7e30d2f5839013d53bb69785ad13238817365cad481fdc" exitCode=0
Jul 23 13:20:26.867674 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:26.867672    2581 generic.go:356] "Generic (PLEG): container finished" podID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerID="e20235b91696d9bed2d1d65dea0f374c900ec0ec6eadcd82f21127a179156db0" exitCode=0
Jul 23 13:20:26.868031 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:26.867714    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"f5d0cf4af2c4c9d65e7e30d2f5839013d53bb69785ad13238817365cad481fdc"}
Jul 23 13:20:26.868031 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:26.867780    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"e20235b91696d9bed2d1d65dea0f374c900ec0ec6eadcd82f21127a179156db0"}
Jul 23 13:20:26.966360 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:26.966340    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:20:27.059192 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059119    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-main-db\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059192    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-web\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059225    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059280    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-metrics-client-ca\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059304    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-tls-assets\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059376    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059406    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-cluster-tls-config\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059433    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059441    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059488    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-config-volume\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059516 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059516    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-web-config\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059569    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-config-out\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059614    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j88xp\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-kube-api-access-j88xp\") pod \"fe4f0344-f722-44b2-ad16-df11a59f9989\" (UID: \"fe4f0344-f722-44b2-ad16-df11a59f9989\") "
Jul 23 13:20:27.059859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059673    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:27.060018 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059920    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-metrics-client-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.060018 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.059940    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-main-db\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.060772 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.060741    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:27.062408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.062383    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.063377 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.063341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-config-volume" (OuterVolumeSpecName: "config-volume") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.063474 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.063381    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.063529 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.063498    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-kube-api-access-j88xp" (OuterVolumeSpecName: "kube-api-access-j88xp") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "kube-api-access-j88xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:20:27.064264 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.064238    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.064363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.064243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:20:27.064363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.064263    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.064363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.064309    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-config-out" (OuterVolumeSpecName: "config-out") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:20:27.068029 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.068001    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.075998 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.075978    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-web-config" (OuterVolumeSpecName: "web-config") pod "fe4f0344-f722-44b2-ad16-df11a59f9989" (UID: "fe4f0344-f722-44b2-ad16-df11a59f9989"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:27.161243 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161222    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161243 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161242    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-main-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161251    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-tls-assets\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161259    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe4f0344-f722-44b2-ad16-df11a59f9989-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161267    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161276    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-cluster-tls-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161284    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161292    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-config-volume\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161301    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fe4f0344-f722-44b2-ad16-df11a59f9989-web-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161307    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fe4f0344-f722-44b2-ad16-df11a59f9989-config-out\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.161363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.161314    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88xp\" (UniqueName: \"kubernetes.io/projected/fe4f0344-f722-44b2-ad16-df11a59f9989-kube-api-access-j88xp\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:27.880931 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.880899    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fe4f0344-f722-44b2-ad16-df11a59f9989","Type":"ContainerDied","Data":"d4885a1af1c66ce69b83870a05f95cf61cd32a674f85799f1c658227f48bd8c0"}
Jul 23 13:20:27.880931 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.880918    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 13:20:27.881354 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.880993    2581 scope.go:117] "RemoveContainer" containerID="1b6ef65a05e237d0e1eadcb42109ac21dd0c9319529b5b8a9499e0814692a867"
Jul 23 13:20:27.889249 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.889234    2581 scope.go:117] "RemoveContainer" containerID="f5d0cf4af2c4c9d65e7e30d2f5839013d53bb69785ad13238817365cad481fdc"
Jul 23 13:20:27.896288 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.896272    2581 scope.go:117] "RemoveContainer" containerID="0d149f3851c5de296135428fff80bdf1af5d167eeffe62ca7d9304dfa9e2bd84"
Jul 23 13:20:27.903462 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.903441    2581 scope.go:117] "RemoveContainer" containerID="e20235b91696d9bed2d1d65dea0f374c900ec0ec6eadcd82f21127a179156db0"
Jul 23 13:20:27.910261 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.910246    2581 scope.go:117] "RemoveContainer" containerID="f38a198801621d48bc0fa842d294d735ce00927babca1d8a73258c4999150543"
Jul 23 13:20:27.917059 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.917042    2581 scope.go:117] "RemoveContainer" containerID="a29f00276355b054fac575d3c3c4236bd0665a3c01b795baba513d596d796dea"
Jul 23 13:20:27.923757 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.923733    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 13:20:27.924844 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.924831    2581 scope.go:117] "RemoveContainer" containerID="99943a420980cea5c4f1ea0f00cf8fc86913c573569e74a8fef48c60db9b988b"
Jul 23 13:20:27.935450 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:27.935431    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 13:20:28.816945 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:28.816913    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" path="/var/lib/kubelet/pods/fe4f0344-f722-44b2-ad16-df11a59f9989/volumes"
Jul 23 13:20:30.025362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025332    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:20:30.025752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025627    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="prometheus" containerID="cri-o://436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e" gracePeriod=600
Jul 23 13:20:30.025752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025649    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy" containerID="cri-o://52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26" gracePeriod=600
Jul 23 13:20:30.025752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025691    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="thanos-sidecar" containerID="cri-o://78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18" gracePeriod=600
Jul 23 13:20:30.025752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025705    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d" gracePeriod=600
Jul 23 13:20:30.025752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025713    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="config-reloader" containerID="cri-o://c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59" gracePeriod=600
Jul 23 13:20:30.026009 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.025777    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-web" containerID="cri-o://632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036" gracePeriod=600
Jul 23 13:20:30.898857 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898820    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d" exitCode=0
Jul 23 13:20:30.898857 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898849    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26" exitCode=0
Jul 23 13:20:30.898857 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898857    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18" exitCode=0
Jul 23 13:20:30.898857 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898865    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59" exitCode=0
Jul 23 13:20:30.899154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898874    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e" exitCode=0
Jul 23 13:20:30.899154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898895    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d"}
Jul 23 13:20:30.899154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898958    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26"}
Jul 23 13:20:30.899154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.898984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18"}
Jul 23 13:20:30.899154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.899009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59"}
Jul 23 13:20:30.899154 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:30.899031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e"}
Jul 23 13:20:31.287913 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.287892    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:31.394361 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394328    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-web-config\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-metrics-client-certs\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394412    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-64c5v\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-kube-api-access-64c5v\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-tls-assets\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394515 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394648    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-metrics-client-ca\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394692    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-kubelet-serving-ca-bundle\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394725 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394719    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-serving-certs-ca-bundle\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394882 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394753    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-db\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394882 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394777    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-grpc-tls\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.394882 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.394804    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-thanos-prometheus-http-client-file\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395300    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395359    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395504    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-trusted-ca-bundle\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395577    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-1\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395613    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-0\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395660    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395684    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-tls\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395711    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-kube-rbac-proxy\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395737    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-2\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395748    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.396646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.395757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.398611 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.398303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config-out\") pod \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\" (UID: \"5723e3f2-8572-492a-8cec-7d9b3c4228b5\") "
Jul 23 13:20:31.398936 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.398910    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config" (OuterVolumeSpecName: "config") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.399013 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.398984    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.399587 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.399559    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.400063 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.400028    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.400786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.400753    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.400965    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.401553    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402137    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402405    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402435    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-metrics-client-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402449    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402465    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-metrics-client-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402507    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402522    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402535    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-grpc-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.402576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.402566    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.403483 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.403459    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:20:31.403576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.403533    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:20:31.403639 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.403590    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.405616 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.404682    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-kube-api-access-64c5v" (OuterVolumeSpecName: "kube-api-access-64c5v") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "kube-api-access-64c5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:20:31.411433 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.410291    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.411433 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.410571    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:20:31.411433 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.411386    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.412005 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.411904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config-out" (OuterVolumeSpecName: "config-out") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 13:20:31.413243 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.413216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.421681 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.421661    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-web-config" (OuterVolumeSpecName: "web-config") pod "5723e3f2-8572-492a-8cec-7d9b3c4228b5" (UID: "5723e3f2-8572-492a-8cec-7d9b3c4228b5"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:20:31.503188 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503140    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503188 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503161    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503188 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503171    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-secret-kube-rbac-proxy\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503188 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503179    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503188 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503187    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-config-out\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503209    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-web-config\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503217    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64c5v\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-kube-api-access-64c5v\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503225    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5723e3f2-8572-492a-8cec-7d9b3c4228b5-tls-assets\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503233    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-k8s-db\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503240    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5723e3f2-8572-492a-8cec-7d9b3c4228b5-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.503381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.503249    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5723e3f2-8572-492a-8cec-7d9b3c4228b5-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:20:31.907408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.907378    2581 generic.go:356] "Generic (PLEG): container finished" podID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerID="632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036" exitCode=0
Jul 23 13:20:31.907546 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.907455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036"}
Jul 23 13:20:31.907546 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.907518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5723e3f2-8572-492a-8cec-7d9b3c4228b5","Type":"ContainerDied","Data":"024117878ceafc753d9dfa494bcd5e217bf36cd962d9bc661473f9f36f763f97"}
Jul 23 13:20:31.907546 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.907460    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:31.907665 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.907564    2581 scope.go:117] "RemoveContainer" containerID="e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d"
Jul 23 13:20:31.915960 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.915940    2581 scope.go:117] "RemoveContainer" containerID="52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26"
Jul 23 13:20:31.923251 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.923236    2581 scope.go:117] "RemoveContainer" containerID="632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036"
Jul 23 13:20:31.930383 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.930367    2581 scope.go:117] "RemoveContainer" containerID="78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18"
Jul 23 13:20:31.936788 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.936773    2581 scope.go:117] "RemoveContainer" containerID="c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59"
Jul 23 13:20:31.945424 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.945404    2581 scope.go:117] "RemoveContainer" containerID="436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e"
Jul 23 13:20:31.946969 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.946950    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:20:31.953355 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.953321    2581 scope.go:117] "RemoveContainer" containerID="beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d"
Jul 23 13:20:31.955588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.955568    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:20:31.960358 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.960343    2581 scope.go:117] "RemoveContainer" containerID="e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d"
Jul 23 13:20:31.960591 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.960573    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d\": container with ID starting with e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d not found: ID does not exist" containerID="e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d"
Jul 23 13:20:31.960646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.960598    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d"} err="failed to get container status \"e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d\": rpc error: code = NotFound desc = could not find container \"e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d\": container with ID starting with e884e27de6f13752460b652296e7496b40cb57171401767ad4764cc0eba2650d not found: ID does not exist"
Jul 23 13:20:31.960646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.960616    2581 scope.go:117] "RemoveContainer" containerID="52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26"
Jul 23 13:20:31.960841 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.960828    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26\": container with ID starting with 52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26 not found: ID does not exist" containerID="52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26"
Jul 23 13:20:31.960880 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.960842    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26"} err="failed to get container status \"52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26\": rpc error: code = NotFound desc = could not find container \"52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26\": container with ID starting with 52f62871d94de7516249f05efcfea651ba3e6834043a8fbdfdbca866ec68ca26 not found: ID does not exist"
Jul 23 13:20:31.960880 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.960853    2581 scope.go:117] "RemoveContainer" containerID="632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036"
Jul 23 13:20:31.961063 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.961047    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036\": container with ID starting with 632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036 not found: ID does not exist" containerID="632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036"
Jul 23 13:20:31.961119 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961068    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036"} err="failed to get container status \"632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036\": rpc error: code = NotFound desc = could not find container \"632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036\": container with ID starting with 632d86dc49a1c6d96efb5e95f673aa6fa6789c3b7b35a7159e7ec5125f89a036 not found: ID does not exist"
Jul 23 13:20:31.961119 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961082    2581 scope.go:117] "RemoveContainer" containerID="78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18"
Jul 23 13:20:31.961290 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.961273    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18\": container with ID starting with 78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18 not found: ID does not exist" containerID="78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18"
Jul 23 13:20:31.961328 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961295    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18"} err="failed to get container status \"78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18\": rpc error: code = NotFound desc = could not find container \"78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18\": container with ID starting with 78b8b68a72da27429379c20cf1807b5bf3c55f9ad89e36c6e6a6512255e6ad18 not found: ID does not exist"
Jul 23 13:20:31.961328 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961311    2581 scope.go:117] "RemoveContainer" containerID="c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59"
Jul 23 13:20:31.961526 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.961511    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59\": container with ID starting with c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59 not found: ID does not exist" containerID="c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59"
Jul 23 13:20:31.961579 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961529    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59"} err="failed to get container status \"c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59\": rpc error: code = NotFound desc = could not find container \"c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59\": container with ID starting with c2454e28dcc1ec1fee2f388345522a226a4bdd75521ea2cb7591dcc07bca9b59 not found: ID does not exist"
Jul 23 13:20:31.961579 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961541    2581 scope.go:117] "RemoveContainer" containerID="436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e"
Jul 23 13:20:31.961743 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.961728    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e\": container with ID starting with 436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e not found: ID does not exist" containerID="436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e"
Jul 23 13:20:31.961777 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961746    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e"} err="failed to get container status \"436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e\": rpc error: code = NotFound desc = could not find container \"436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e\": container with ID starting with 436fc6e717dae471837fc450bfe2346c9f87af54784629eec2947354151d373e not found: ID does not exist"
Jul 23 13:20:31.961777 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961756    2581 scope.go:117] "RemoveContainer" containerID="beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d"
Jul 23 13:20:31.961970 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:20:31.961954    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d\": container with ID starting with beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d not found: ID does not exist" containerID="beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d"
Jul 23 13:20:31.962017 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.961972    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d"} err="failed to get container status \"beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d\": rpc error: code = NotFound desc = could not find container \"beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d\": container with ID starting with beccb114bf553eafa79d03d6ad49f448bae7b109b849f5a61e436d259b58537d not found: ID does not exist"
Jul 23 13:20:31.999337 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999318    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:20:31.999649 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999637    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-web"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999652    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-web"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999662    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999668    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999676    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f6af983-9b53-4e8c-8671-51f16e936ef0" containerName="registry"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999681    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f6af983-9b53-4e8c-8671-51f16e936ef0" containerName="registry"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999690    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-web"
Jul 23 13:20:31.999695 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999694    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-web"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999701    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-thanos"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999706    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-thanos"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999714    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999718    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999724    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999729    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999737    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="alertmanager"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999742    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="alertmanager"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999747    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="prometheus"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999752    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="prometheus"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999757    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="thanos-sidecar"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999762    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="thanos-sidecar"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999773    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="init-config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999778    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="init-config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999783    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-metric"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999789    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-metric"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999795    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="prom-label-proxy"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999799    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="prom-label-proxy"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999805    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="init-config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999810    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="init-config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999817    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999824    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999832    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" containerName="console"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999840    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" containerName="console"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999910    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-metric"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999919    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="config-reloader"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999926    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="thanos-sidecar"
Jul 23 13:20:31.999923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999931    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999938    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f6af983-9b53-4e8c-8671-51f16e936ef0" containerName="registry"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999944    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="prometheus"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999949    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="alertmanager"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999953    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999957    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-thanos"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999963    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" containerName="kube-rbac-proxy-web"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999967    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="prom-label-proxy"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999972    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="kube-rbac-proxy-web"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999977    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a651e94-2f1c-41b7-89e1-aac4f1c06eb1" containerName="console"
Jul 23 13:20:32.000660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:31.999983    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe4f0344-f722-44b2-ad16-df11a59f9989" containerName="config-reloader"
Jul 23 13:20:32.003997 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.003971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.010054 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.010032    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 23 13:20:32.010250 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.010237    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 23 13:20:32.010447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.010433    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 23 13:20:32.010523 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.010476    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 23 13:20:32.010735 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.010693    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 23 13:20:32.010735 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.010719    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 23 13:20:32.011239 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 23 13:20:32.011329 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011280    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 23 13:20:32.011468 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011455    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 23 13:20:32.011535 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011483    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 23 13:20:32.011535 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a4vfjevgf4kg0\""
Jul 23 13:20:32.011696 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011678    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wl8lc\""
Jul 23 13:20:32.011772 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011684    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 23 13:20:32.012004 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.011986    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 23 13:20:32.016155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.016139    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 23 13:20:32.019721 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.019705    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 23 13:20:32.031807 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.031783    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:20:32.108168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108147    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108269 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108174    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108269 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1a66800-7f27-46b1-82af-13f941b15c99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108269 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-config\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108413    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108598 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzz8w\" (UniqueName: \"kubernetes.io/projected/a1a66800-7f27-46b1-82af-13f941b15c99-kube-api-access-kzz8w\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108598 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1a66800-7f27-46b1-82af-13f941b15c99-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108598 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108598 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108564    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108598 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108611    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108661    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108692    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.108760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.108748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210072 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210072 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210072 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1a66800-7f27-46b1-82af-13f941b15c99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-config\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210197    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210224    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzz8w\" (UniqueName: \"kubernetes.io/projected/a1a66800-7f27-46b1-82af-13f941b15c99-kube-api-access-kzz8w\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210309    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1a66800-7f27-46b1-82af-13f941b15c99-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210331    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210355    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210468    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.210557 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210543    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211205 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211205 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210795    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211205 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.210861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211353 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.211218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211440 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.211416    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211506 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.211488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211627 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.211608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.211963 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.211936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.213585 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.213512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-config\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.213585 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.213549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.213984 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.213902    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a1a66800-7f27-46b1-82af-13f941b15c99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.214202 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.214173    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a1a66800-7f27-46b1-82af-13f941b15c99-config-out\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.214613 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.214593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.214859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.214723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a1a66800-7f27-46b1-82af-13f941b15c99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.214859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.214847    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.215375 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.215353    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.215888 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.215862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.216003 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.215985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.216751 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.216735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-web-config\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.217073 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.217058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a1a66800-7f27-46b1-82af-13f941b15c99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.225752 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.225729    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzz8w\" (UniqueName: \"kubernetes.io/projected/a1a66800-7f27-46b1-82af-13f941b15c99-kube-api-access-kzz8w\") pod \"prometheus-k8s-0\" (UID: \"a1a66800-7f27-46b1-82af-13f941b15c99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.313441 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.313421    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:20:32.470637 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.470613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 23 13:20:32.472520 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:20:32.472491    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a66800_7f27_46b1_82af_13f941b15c99.slice/crio-01f2af08630bfbc7d89b1daa4f0d665f6e0f2b8edf6844a5302a13b42945e1ce WatchSource:0}: Error finding container 01f2af08630bfbc7d89b1daa4f0d665f6e0f2b8edf6844a5302a13b42945e1ce: Status 404 returned error can't find the container with id 01f2af08630bfbc7d89b1daa4f0d665f6e0f2b8edf6844a5302a13b42945e1ce
Jul 23 13:20:32.817353 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.817279    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5723e3f2-8572-492a-8cec-7d9b3c4228b5" path="/var/lib/kubelet/pods/5723e3f2-8572-492a-8cec-7d9b3c4228b5/volumes"
Jul 23 13:20:32.912767 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.912735    2581 generic.go:356] "Generic (PLEG): container finished" podID="a1a66800-7f27-46b1-82af-13f941b15c99" containerID="84af79cc5db6cc6fce072beea7b1f730f44b7d4e99e80dd5fd64ab866e567790" exitCode=0
Jul 23 13:20:32.912889 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.912826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerDied","Data":"84af79cc5db6cc6fce072beea7b1f730f44b7d4e99e80dd5fd64ab866e567790"}
Jul 23 13:20:32.912950 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:32.912901    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"01f2af08630bfbc7d89b1daa4f0d665f6e0f2b8edf6844a5302a13b42945e1ce"}
Jul 23 13:20:33.922416 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.922381    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"9f02de259e19bbfa0f2a5afdf08cbef2ee1b611fd61cacbced212fc6d2bb30e7"}
Jul 23 13:20:33.922797 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.922473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"fe0ee1cbb640ec0b3f4ddaaaa34dab89d8d86283624f00ee0232d35e4f90e0a1"}
Jul 23 13:20:33.922797 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.922503    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"9b96b644c64d2f5c347221a8557eda50476654d93d645afa5ab50edbf73fcf35"}
Jul 23 13:20:33.922797 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.922530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"e087d473a0991e68f14afcbdd4a568f140dd5cc36309ed8d92d3ec9485fb379b"}
Jul 23 13:20:33.922797 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.922555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"e1bb70e0a587fc40ae96ae296311e4e5392b0a085a5dadd5bc72efdc9750470d"}
Jul 23 13:20:33.922797 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.922581    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a1a66800-7f27-46b1-82af-13f941b15c99","Type":"ContainerStarted","Data":"d4b9b35591343a15a449736abf4e67bb8ab88d227291a05fbb7901e2f6886f0b"}
Jul 23 13:20:33.972206 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:33.972158    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.953410934 podStartE2EDuration="2.972142861s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.731927ms" isStatefulPod=false podCreationTimestamp="2026-07-23 13:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:20:33.971891498 +0000 UTC m=+177.644756932" watchObservedRunningTime="2026-07-23 13:20:33.972142861 +0000 UTC m=+177.645008300"
Jul 23 13:20:37.313660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:20:37.313631    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:21:32.314623 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:21:32.314585    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:21:32.330786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:21:32.330763    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:21:33.204045 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:21:33.204013    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 23 13:22:29.295581 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.295539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"]
Jul 23 13:22:29.298104 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.298071    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.301921 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.301903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 13:22:29.301921 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.301912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 13:22:29.302418 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.302395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-msj2f\""
Jul 23 13:22:29.302523 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.302489    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 13:22:29.302683 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.302668    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 13:22:29.317345 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.317325    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"]
Jul 23 13:22:29.339827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.339803    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db10710a-18bc-4d35-94f2-072bb7cd4430-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.340023 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.339998    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db10710a-18bc-4d35-94f2-072bb7cd4430-tmp\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.340162 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.340034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6qjf\" (UniqueName: \"kubernetes.io/projected/db10710a-18bc-4d35-94f2-072bb7cd4430-kube-api-access-l6qjf\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.340228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.340171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db10710a-18bc-4d35-94f2-072bb7cd4430-webhook-cert\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.340228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.340201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db10710a-18bc-4d35-94f2-072bb7cd4430-manifests\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.440825 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.440797    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db10710a-18bc-4d35-94f2-072bb7cd4430-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.440952 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.440833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db10710a-18bc-4d35-94f2-072bb7cd4430-tmp\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.440952 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.440849    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6qjf\" (UniqueName: \"kubernetes.io/projected/db10710a-18bc-4d35-94f2-072bb7cd4430-kube-api-access-l6qjf\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.440952 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.440901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db10710a-18bc-4d35-94f2-072bb7cd4430-webhook-cert\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.440952 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.440922    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db10710a-18bc-4d35-94f2-072bb7cd4430-manifests\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.441335 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.441312    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db10710a-18bc-4d35-94f2-072bb7cd4430-manifests\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.443535 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.443510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db10710a-18bc-4d35-94f2-072bb7cd4430-apiservice-cert\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.443757 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.443735    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db10710a-18bc-4d35-94f2-072bb7cd4430-tmp\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.443831 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.443816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db10710a-18bc-4d35-94f2-072bb7cd4430-webhook-cert\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.466698 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.466678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6qjf\" (UniqueName: \"kubernetes.io/projected/db10710a-18bc-4d35-94f2-072bb7cd4430-kube-api-access-l6qjf\") pod \"opendatahub-operator-controller-manager-694f99b88-dfg2g\" (UID: \"db10710a-18bc-4d35-94f2-072bb7cd4430\") " pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.608646 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.608572    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:29.752834 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:29.752805    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"]
Jul 23 13:22:29.756500 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:22:29.756470    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb10710a_18bc_4d35_94f2_072bb7cd4430.slice/crio-831030294e98d6a1dc7114d63936f646bf10e0dd76078e4ad6147f493fa1f42c WatchSource:0}: Error finding container 831030294e98d6a1dc7114d63936f646bf10e0dd76078e4ad6147f493fa1f42c: Status 404 returned error can't find the container with id 831030294e98d6a1dc7114d63936f646bf10e0dd76078e4ad6147f493fa1f42c
Jul 23 13:22:30.451150 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:30.451116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g" event={"ID":"db10710a-18bc-4d35-94f2-072bb7cd4430","Type":"ContainerStarted","Data":"831030294e98d6a1dc7114d63936f646bf10e0dd76078e4ad6147f493fa1f42c"}
Jul 23 13:22:34.474649 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:34.474612    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g" event={"ID":"db10710a-18bc-4d35-94f2-072bb7cd4430","Type":"ContainerStarted","Data":"ee40292103bc10107450af6b9bc25c8a521c881d98ad11ad7b93b1bc881434f8"}
Jul 23 13:22:35.480719 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:35.480682    2581 generic.go:356] "Generic (PLEG): container finished" podID="db10710a-18bc-4d35-94f2-072bb7cd4430" containerID="ee40292103bc10107450af6b9bc25c8a521c881d98ad11ad7b93b1bc881434f8" exitCode=0
Jul 23 13:22:35.481133 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:35.480752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g" event={"ID":"db10710a-18bc-4d35-94f2-072bb7cd4430","Type":"ContainerDied","Data":"ee40292103bc10107450af6b9bc25c8a521c881d98ad11ad7b93b1bc881434f8"}
Jul 23 13:22:36.754081 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:36.754049    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:22:36.761625 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:36.761601    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:22:36.765744 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:36.765727    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 13:22:37.492192 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:37.492154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g" event={"ID":"db10710a-18bc-4d35-94f2-072bb7cd4430","Type":"ContainerStarted","Data":"754d95cce06ea65f134d753fc3c1e186e151a50bb4ab7200ce7433da6cc8b354"}
Jul 23 13:22:37.492382 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:37.492302    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:37.515187 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:37.515141    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g" podStartSLOduration=2.068884167 podStartE2EDuration="8.515125082s" totalImagesPullingTime="5.426857487s" totalInitContainerRuntime="1.019383428s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:22:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:22:37.513243698 +0000 UTC m=+301.186109149" watchObservedRunningTime="2026-07-23 13:22:37.515125082 +0000 UTC m=+301.187990523"
Jul 23 13:22:48.500377 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.500346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-694f99b88-dfg2g"
Jul 23 13:22:48.545744 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.545715    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"]
Jul 23 13:22:48.555400 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.555385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.564583 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.564554    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 23 13:22:48.564702 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.564563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 23 13:22:48.564878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.564856    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 23 13:22:48.565180 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.565164    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rmcjt\""
Jul 23 13:22:48.565180 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.565171    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 23 13:22:48.565353 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.565316    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 23 13:22:48.579178 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.579155    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"]
Jul 23 13:22:48.704494 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.704464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-metrics-cert\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.704494 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.704498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-manager-config\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.704676 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.704520    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-cert\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.704676 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.704629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98zbm\" (UniqueName: \"kubernetes.io/projected/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-kube-api-access-98zbm\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.805823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.805749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98zbm\" (UniqueName: \"kubernetes.io/projected/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-kube-api-access-98zbm\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.805823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.805798    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-metrics-cert\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.805823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.805820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-manager-config\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.806021 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.805839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-cert\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.806438 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.806417    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-manager-config\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.808333 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.808306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-metrics-cert\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.808452 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.808436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-cert\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.815443 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.815423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98zbm\" (UniqueName: \"kubernetes.io/projected/e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5-kube-api-access-98zbm\") pod \"lws-controller-manager-8d7f7f5f-mv42b\" (UID: \"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5\") " pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:48.864417 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:48.864385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:49.018499 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:49.018474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"]
Jul 23 13:22:49.020372 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:22:49.020343    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27e5b22_19b1_4de4_89dc_bcf5b1d3b9d5.slice/crio-15a6c171fa4d9e5f22bbff353d1a49efc748b95b9e3c05e6ab780c30fe2024a9 WatchSource:0}: Error finding container 15a6c171fa4d9e5f22bbff353d1a49efc748b95b9e3c05e6ab780c30fe2024a9: Status 404 returned error can't find the container with id 15a6c171fa4d9e5f22bbff353d1a49efc748b95b9e3c05e6ab780c30fe2024a9
Jul 23 13:22:49.022316 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:49.022301    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:22:49.548141 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:49.548113    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b" event={"ID":"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5","Type":"ContainerStarted","Data":"15a6c171fa4d9e5f22bbff353d1a49efc748b95b9e3c05e6ab780c30fe2024a9"}
Jul 23 13:22:51.915682 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:51.915648    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"]
Jul 23 13:22:51.919197 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:51.919178    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:51.936962 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:51.936944    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 13:22:51.946807 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:51.946781    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g44gr\""
Jul 23 13:22:51.960276 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:51.960255    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 13:22:51.993690 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:51.993660    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"]
Jul 23 13:22:52.036998 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.036958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbm5k\" (UniqueName: \"kubernetes.io/projected/c3d6c359-5e28-4fb3-969d-56a6f3567531-kube-api-access-fbm5k\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.037194 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.037009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3d6c359-5e28-4fb3-969d-56a6f3567531-tmp\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.037194 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.037128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d6c359-5e28-4fb3-969d-56a6f3567531-tls-certs\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.138197 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.138170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d6c359-5e28-4fb3-969d-56a6f3567531-tls-certs\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.138381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.138256    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbm5k\" (UniqueName: \"kubernetes.io/projected/c3d6c359-5e28-4fb3-969d-56a6f3567531-kube-api-access-fbm5k\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.138381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.138314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3d6c359-5e28-4fb3-969d-56a6f3567531-tmp\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.140609 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.140580    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3d6c359-5e28-4fb3-969d-56a6f3567531-tmp\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.140809 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.140788    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3d6c359-5e28-4fb3-969d-56a6f3567531-tls-certs\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.191068 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.191011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbm5k\" (UniqueName: \"kubernetes.io/projected/c3d6c359-5e28-4fb3-969d-56a6f3567531-kube-api-access-fbm5k\") pod \"kube-auth-proxy-75b4c49cfd-klp2h\" (UID: \"c3d6c359-5e28-4fb3-969d-56a6f3567531\") " pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.228624 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.228603    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"
Jul 23 13:22:52.407659 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.407637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h"]
Jul 23 13:22:52.410074 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:22:52.410050    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d6c359_5e28_4fb3_969d_56a6f3567531.slice/crio-8a521f04049153bb62e987f03235677dc14cb186c3aba4dee57b8a5348e24ed2 WatchSource:0}: Error finding container 8a521f04049153bb62e987f03235677dc14cb186c3aba4dee57b8a5348e24ed2: Status 404 returned error can't find the container with id 8a521f04049153bb62e987f03235677dc14cb186c3aba4dee57b8a5348e24ed2
Jul 23 13:22:52.564227 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.564139    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b" event={"ID":"e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5","Type":"ContainerStarted","Data":"4936e44f30e74e6b74f5f1685e9fc5168fa765eed82872b9eb286f429a65b4d1"}
Jul 23 13:22:52.564371 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.564269    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:22:52.565506 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:52.565481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h" event={"ID":"c3d6c359-5e28-4fb3-969d-56a6f3567531","Type":"ContainerStarted","Data":"8a521f04049153bb62e987f03235677dc14cb186c3aba4dee57b8a5348e24ed2"}
Jul 23 13:22:55.581840 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:55.581804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h" event={"ID":"c3d6c359-5e28-4fb3-969d-56a6f3567531","Type":"ContainerStarted","Data":"d9ccbdafd67de4f38fbf45301ddbdba7803981705ccabaf1fa3f07cd141d3ae4"}
Jul 23 13:22:55.642478 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:55.642426    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75b4c49cfd-klp2h" podStartSLOduration=2.282702505 podStartE2EDuration="4.642410464s" totalImagesPullingTime="2.359707959s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:22:55.641825175 +0000 UTC m=+319.314690617" watchObservedRunningTime="2026-07-23 13:22:55.642410464 +0000 UTC m=+319.315275947"
Jul 23 13:22:55.643467 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:22:55.643438    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b" podStartSLOduration=5.098206469 podStartE2EDuration="7.643428245s" totalImagesPullingTime="2.545221776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:22:52.638838466 +0000 UTC m=+316.311703907" watchObservedRunningTime="2026-07-23 13:22:55.643428245 +0000 UTC m=+319.316293707"
Jul 23 13:23:03.572236 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:23:03.572204    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8d7f7f5f-mv42b"
Jul 23 13:25:35.897335 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.897296    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:25:35.900605 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.900582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:35.903766 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.903739    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6cp99\""
Jul 23 13:25:35.904215 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.904192    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 13:25:35.905225 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.905207    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 13:25:35.905225 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.905220    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 13:25:35.910117 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.910074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:25:35.940328 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:35.940295    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:25:36.036116 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.036054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/192cda73-698f-481a-bce5-71659c29041e-config-file\") pod \"limitador-limitador-54d6d988d5-dqd8n\" (UID: \"192cda73-698f-481a-bce5-71659c29041e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.036304 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.036197    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44hf2\" (UniqueName: \"kubernetes.io/projected/192cda73-698f-481a-bce5-71659c29041e-kube-api-access-44hf2\") pod \"limitador-limitador-54d6d988d5-dqd8n\" (UID: \"192cda73-698f-481a-bce5-71659c29041e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.137118 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.137052    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44hf2\" (UniqueName: \"kubernetes.io/projected/192cda73-698f-481a-bce5-71659c29041e-kube-api-access-44hf2\") pod \"limitador-limitador-54d6d988d5-dqd8n\" (UID: \"192cda73-698f-481a-bce5-71659c29041e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.137321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.137133    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/192cda73-698f-481a-bce5-71659c29041e-config-file\") pod \"limitador-limitador-54d6d988d5-dqd8n\" (UID: \"192cda73-698f-481a-bce5-71659c29041e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.137729 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.137710    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/192cda73-698f-481a-bce5-71659c29041e-config-file\") pod \"limitador-limitador-54d6d988d5-dqd8n\" (UID: \"192cda73-698f-481a-bce5-71659c29041e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.147290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.147262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44hf2\" (UniqueName: \"kubernetes.io/projected/192cda73-698f-481a-bce5-71659c29041e-kube-api-access-44hf2\") pod \"limitador-limitador-54d6d988d5-dqd8n\" (UID: \"192cda73-698f-481a-bce5-71659c29041e\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.213831 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.213757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:36.239257 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.239227    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-brvpp"]
Jul 23 13:25:36.242829 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.242801    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:36.245767 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.245748    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pw7ht\""
Jul 23 13:25:36.254331 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.254307    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-brvpp"]
Jul 23 13:25:36.339724 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.339694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67ntx\" (UniqueName: \"kubernetes.io/projected/8fe67378-6c14-447a-9889-1f07c42cc4e6-kube-api-access-67ntx\") pod \"authorino-58cd955675-brvpp\" (UID: \"8fe67378-6c14-447a-9889-1f07c42cc4e6\") " pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:36.357242 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.357221    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:25:36.359308 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:25:36.359283    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod192cda73_698f_481a_bce5_71659c29041e.slice/crio-94b4b75456094978bf20cd565387cfb89e40261833a2b6cef3b3e220d20d7bdc WatchSource:0}: Error finding container 94b4b75456094978bf20cd565387cfb89e40261833a2b6cef3b3e220d20d7bdc: Status 404 returned error can't find the container with id 94b4b75456094978bf20cd565387cfb89e40261833a2b6cef3b3e220d20d7bdc
Jul 23 13:25:36.441220 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.441191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67ntx\" (UniqueName: \"kubernetes.io/projected/8fe67378-6c14-447a-9889-1f07c42cc4e6-kube-api-access-67ntx\") pod \"authorino-58cd955675-brvpp\" (UID: \"8fe67378-6c14-447a-9889-1f07c42cc4e6\") " pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:36.459158 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.459139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67ntx\" (UniqueName: \"kubernetes.io/projected/8fe67378-6c14-447a-9889-1f07c42cc4e6-kube-api-access-67ntx\") pod \"authorino-58cd955675-brvpp\" (UID: \"8fe67378-6c14-447a-9889-1f07c42cc4e6\") " pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:36.558975 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.558905    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:36.699446 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:36.699419    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-brvpp"]
Jul 23 13:25:36.701002 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:25:36.700975    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8fe67378_6c14_447a_9889_1f07c42cc4e6.slice/crio-5217c1e3d83a5f1347971b8eceb97ee8b0f070dd2b4f71bd56fdf8e8b638b3ef WatchSource:0}: Error finding container 5217c1e3d83a5f1347971b8eceb97ee8b0f070dd2b4f71bd56fdf8e8b638b3ef: Status 404 returned error can't find the container with id 5217c1e3d83a5f1347971b8eceb97ee8b0f070dd2b4f71bd56fdf8e8b638b3ef
Jul 23 13:25:37.348797 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:37.348728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n" event={"ID":"192cda73-698f-481a-bce5-71659c29041e","Type":"ContainerStarted","Data":"94b4b75456094978bf20cd565387cfb89e40261833a2b6cef3b3e220d20d7bdc"}
Jul 23 13:25:37.350911 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:37.350876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-brvpp" event={"ID":"8fe67378-6c14-447a-9889-1f07c42cc4e6","Type":"ContainerStarted","Data":"5217c1e3d83a5f1347971b8eceb97ee8b0f070dd2b4f71bd56fdf8e8b638b3ef"}
Jul 23 13:25:39.808348 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:39.808274    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-brvpp"]
Jul 23 13:25:40.374802 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:40.374754    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-brvpp" event={"ID":"8fe67378-6c14-447a-9889-1f07c42cc4e6","Type":"ContainerStarted","Data":"ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c"}
Jul 23 13:25:40.392043 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:40.391942    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-brvpp" podStartSLOduration=1.41081367 podStartE2EDuration="4.391920786s" totalImagesPullingTime="2.981107116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:25:40.391471008 +0000 UTC m=+484.064336470" watchObservedRunningTime="2026-07-23 13:25:40.391920786 +0000 UTC m=+484.064786228"
Jul 23 13:25:41.380186 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:41.380149    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-brvpp" podUID="8fe67378-6c14-447a-9889-1f07c42cc4e6" containerName="authorino" containerID="cri-o://ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c" gracePeriod=30
Jul 23 13:25:41.953754 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:41.953736    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:42.098300 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.098231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67ntx\" (UniqueName: \"kubernetes.io/projected/8fe67378-6c14-447a-9889-1f07c42cc4e6-kube-api-access-67ntx\") pod \"8fe67378-6c14-447a-9889-1f07c42cc4e6\" (UID: \"8fe67378-6c14-447a-9889-1f07c42cc4e6\") "
Jul 23 13:25:42.100469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.100446    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8fe67378-6c14-447a-9889-1f07c42cc4e6-kube-api-access-67ntx" (OuterVolumeSpecName: "kube-api-access-67ntx") pod "8fe67378-6c14-447a-9889-1f07c42cc4e6" (UID: "8fe67378-6c14-447a-9889-1f07c42cc4e6"). InnerVolumeSpecName "kube-api-access-67ntx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:25:42.198864 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.198840    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67ntx\" (UniqueName: \"kubernetes.io/projected/8fe67378-6c14-447a-9889-1f07c42cc4e6-kube-api-access-67ntx\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:25:42.386212 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.386176    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n" event={"ID":"192cda73-698f-481a-bce5-71659c29041e","Type":"ContainerStarted","Data":"a56582dcff0a7d127243955856aa1316ab48a2cb9b1f86ad734929ea8149e5cf"}
Jul 23 13:25:42.386613 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.386251    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:25:42.387482 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.387453    2581 generic.go:356] "Generic (PLEG): container finished" podID="8fe67378-6c14-447a-9889-1f07c42cc4e6" containerID="ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c" exitCode=0
Jul 23 13:25:42.387618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.387497    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-brvpp"
Jul 23 13:25:42.387618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.387521    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-brvpp" event={"ID":"8fe67378-6c14-447a-9889-1f07c42cc4e6","Type":"ContainerDied","Data":"ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c"}
Jul 23 13:25:42.387618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.387555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-brvpp" event={"ID":"8fe67378-6c14-447a-9889-1f07c42cc4e6","Type":"ContainerDied","Data":"5217c1e3d83a5f1347971b8eceb97ee8b0f070dd2b4f71bd56fdf8e8b638b3ef"}
Jul 23 13:25:42.387618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.387575    2581 scope.go:117] "RemoveContainer" containerID="ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c"
Jul 23 13:25:42.396079 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.396063    2581 scope.go:117] "RemoveContainer" containerID="ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c"
Jul 23 13:25:42.396357 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:25:42.396339    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c\": container with ID starting with ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c not found: ID does not exist" containerID="ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c"
Jul 23 13:25:42.396428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.396366    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c"} err="failed to get container status \"ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c\": rpc error: code = NotFound desc = could not find container \"ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c\": container with ID starting with ca56ff48b51a50fd866192e9028b0a8430cc122fb8059dc4b0597e994b1ed36c not found: ID does not exist"
Jul 23 13:25:42.405401 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.405365    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n" podStartSLOduration=1.9008125869999999 podStartE2EDuration="7.405353963s" totalImagesPullingTime="5.504541376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:25:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:25:42.404056356 +0000 UTC m=+486.076921798" watchObservedRunningTime="2026-07-23 13:25:42.405353963 +0000 UTC m=+486.078219403"
Jul 23 13:25:42.417588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.417568    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-brvpp"]
Jul 23 13:25:42.421605 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.421586    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-brvpp"]
Jul 23 13:25:42.817659 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:42.817584    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fe67378-6c14-447a-9889-1f07c42cc4e6" path="/var/lib/kubelet/pods/8fe67378-6c14-447a-9889-1f07c42cc4e6/volumes"
Jul 23 13:25:53.395052 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:25:53.395024    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"
Jul 23 13:26:11.950731 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.950702    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-26n6f"]
Jul 23 13:26:11.951167 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.951101    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fe67378-6c14-447a-9889-1f07c42cc4e6" containerName="authorino"
Jul 23 13:26:11.951167 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.951113    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fe67378-6c14-447a-9889-1f07c42cc4e6" containerName="authorino"
Jul 23 13:26:11.951240 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.951185    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fe67378-6c14-447a-9889-1f07c42cc4e6" containerName="authorino"
Jul 23 13:26:11.956579 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.956560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:11.960586 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.960565    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pw7ht\""
Jul 23 13:26:11.973462 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:11.973441    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-26n6f"]
Jul 23 13:26:12.031859 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.031834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdnpg\" (UniqueName: \"kubernetes.io/projected/9ca463c1-d6e8-4e83-b0e9-24d1074626a5-kube-api-access-vdnpg\") pod \"authorino-5d4b67c446-26n6f\" (UID: \"9ca463c1-d6e8-4e83-b0e9-24d1074626a5\") " pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:12.132740 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.132716    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdnpg\" (UniqueName: \"kubernetes.io/projected/9ca463c1-d6e8-4e83-b0e9-24d1074626a5-kube-api-access-vdnpg\") pod \"authorino-5d4b67c446-26n6f\" (UID: \"9ca463c1-d6e8-4e83-b0e9-24d1074626a5\") " pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:12.154531 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.154510    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdnpg\" (UniqueName: \"kubernetes.io/projected/9ca463c1-d6e8-4e83-b0e9-24d1074626a5-kube-api-access-vdnpg\") pod \"authorino-5d4b67c446-26n6f\" (UID: \"9ca463c1-d6e8-4e83-b0e9-24d1074626a5\") " pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:12.188520 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.188489    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-26n6f"]
Jul 23 13:26:12.188723 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.188708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:12.341993 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.341952    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-26n6f"]
Jul 23 13:26:12.344661 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:26:12.344635    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ca463c1_d6e8_4e83_b0e9_24d1074626a5.slice/crio-2e0a214c135fe2f05f75d8aff9d10513bc6687c8e97067df8a84a6f61d60ca13 WatchSource:0}: Error finding container 2e0a214c135fe2f05f75d8aff9d10513bc6687c8e97067df8a84a6f61d60ca13: Status 404 returned error can't find the container with id 2e0a214c135fe2f05f75d8aff9d10513bc6687c8e97067df8a84a6f61d60ca13
Jul 23 13:26:12.465357 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.465332    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f8c58f774-7dpzk"]
Jul 23 13:26:12.468391 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.468376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.471918 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.471899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 13:26:12.480961 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.480941    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f8c58f774-7dpzk"]
Jul 23 13:26:12.529566 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.529501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-26n6f" event={"ID":"9ca463c1-d6e8-4e83-b0e9-24d1074626a5","Type":"ContainerStarted","Data":"2e0a214c135fe2f05f75d8aff9d10513bc6687c8e97067df8a84a6f61d60ca13"}
Jul 23 13:26:12.534906 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.534880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9m4v\" (UniqueName: \"kubernetes.io/projected/6436ffd7-8544-47e0-87a6-add94ce392c4-kube-api-access-f9m4v\") pod \"authorino-6f8c58f774-7dpzk\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") " pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.535009 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.534942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6436ffd7-8544-47e0-87a6-add94ce392c4-tls-cert\") pod \"authorino-6f8c58f774-7dpzk\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") " pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.636096 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.636069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6436ffd7-8544-47e0-87a6-add94ce392c4-tls-cert\") pod \"authorino-6f8c58f774-7dpzk\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") " pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.636442 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.636164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9m4v\" (UniqueName: \"kubernetes.io/projected/6436ffd7-8544-47e0-87a6-add94ce392c4-kube-api-access-f9m4v\") pod \"authorino-6f8c58f774-7dpzk\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") " pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.638642 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.638620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6436ffd7-8544-47e0-87a6-add94ce392c4-tls-cert\") pod \"authorino-6f8c58f774-7dpzk\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") " pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.647419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.647395    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9m4v\" (UniqueName: \"kubernetes.io/projected/6436ffd7-8544-47e0-87a6-add94ce392c4-kube-api-access-f9m4v\") pod \"authorino-6f8c58f774-7dpzk\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") " pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.777418 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.777390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:26:12.919587 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:12.919563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f8c58f774-7dpzk"]
Jul 23 13:26:12.922893 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:26:12.922861    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6436ffd7_8544_47e0_87a6_add94ce392c4.slice/crio-eb85068178e18ef10bee571ad39b1e6a710e4a7fb152dac297602c07acbf4d60 WatchSource:0}: Error finding container eb85068178e18ef10bee571ad39b1e6a710e4a7fb152dac297602c07acbf4d60: Status 404 returned error can't find the container with id eb85068178e18ef10bee571ad39b1e6a710e4a7fb152dac297602c07acbf4d60
Jul 23 13:26:13.536137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.536102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f8c58f774-7dpzk" event={"ID":"6436ffd7-8544-47e0-87a6-add94ce392c4","Type":"ContainerStarted","Data":"3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0"}
Jul 23 13:26:13.536588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.536148    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f8c58f774-7dpzk" event={"ID":"6436ffd7-8544-47e0-87a6-add94ce392c4","Type":"ContainerStarted","Data":"eb85068178e18ef10bee571ad39b1e6a710e4a7fb152dac297602c07acbf4d60"}
Jul 23 13:26:13.537647 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.537621    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-26n6f" event={"ID":"9ca463c1-d6e8-4e83-b0e9-24d1074626a5","Type":"ContainerStarted","Data":"68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf"}
Jul 23 13:26:13.537772 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.537658    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-26n6f" podUID="9ca463c1-d6e8-4e83-b0e9-24d1074626a5" containerName="authorino" containerID="cri-o://68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf" gracePeriod=30
Jul 23 13:26:13.559809 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.559767    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f8c58f774-7dpzk" podStartSLOduration=1.159837655 podStartE2EDuration="1.559752937s" totalImagesPullingTime="399.915282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:26:13.55778127 +0000 UTC m=+517.230646711" watchObservedRunningTime="2026-07-23 13:26:13.559752937 +0000 UTC m=+517.232618378"
Jul 23 13:26:13.773766 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.773734    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:13.851242 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.851160    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vdnpg\" (UniqueName: \"kubernetes.io/projected/9ca463c1-d6e8-4e83-b0e9-24d1074626a5-kube-api-access-vdnpg\") pod \"9ca463c1-d6e8-4e83-b0e9-24d1074626a5\" (UID: \"9ca463c1-d6e8-4e83-b0e9-24d1074626a5\") "
Jul 23 13:26:13.853325 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.853300    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca463c1-d6e8-4e83-b0e9-24d1074626a5-kube-api-access-vdnpg" (OuterVolumeSpecName: "kube-api-access-vdnpg") pod "9ca463c1-d6e8-4e83-b0e9-24d1074626a5" (UID: "9ca463c1-d6e8-4e83-b0e9-24d1074626a5"). InnerVolumeSpecName "kube-api-access-vdnpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:26:13.952929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:13.952904    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vdnpg\" (UniqueName: \"kubernetes.io/projected/9ca463c1-d6e8-4e83-b0e9-24d1074626a5-kube-api-access-vdnpg\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:26:14.546814 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.546701    2581 generic.go:356] "Generic (PLEG): container finished" podID="9ca463c1-d6e8-4e83-b0e9-24d1074626a5" containerID="68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf" exitCode=0
Jul 23 13:26:14.546814 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.546775    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-26n6f" event={"ID":"9ca463c1-d6e8-4e83-b0e9-24d1074626a5","Type":"ContainerDied","Data":"68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf"}
Jul 23 13:26:14.547357 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.546833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-26n6f" event={"ID":"9ca463c1-d6e8-4e83-b0e9-24d1074626a5","Type":"ContainerDied","Data":"2e0a214c135fe2f05f75d8aff9d10513bc6687c8e97067df8a84a6f61d60ca13"}
Jul 23 13:26:14.547357 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.546857    2581 scope.go:117] "RemoveContainer" containerID="68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf"
Jul 23 13:26:14.547357 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.546790    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-26n6f"
Jul 23 13:26:14.555802 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.555787    2581 scope.go:117] "RemoveContainer" containerID="68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf"
Jul 23 13:26:14.556052 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:26:14.556032    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf\": container with ID starting with 68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf not found: ID does not exist" containerID="68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf"
Jul 23 13:26:14.556139 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.556059    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf"} err="failed to get container status \"68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf\": rpc error: code = NotFound desc = could not find container \"68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf\": container with ID starting with 68adde390cfe0f80a4d4e5484c59ea9afa644741c283462a52121dd715002bcf not found: ID does not exist"
Jul 23 13:26:14.591469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.591446    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-26n6f"]
Jul 23 13:26:14.606461 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.606442    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-26n6f"]
Jul 23 13:26:14.818242 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:14.818171    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca463c1-d6e8-4e83-b0e9-24d1074626a5" path="/var/lib/kubelet/pods/9ca463c1-d6e8-4e83-b0e9-24d1074626a5/volumes"
Jul 23 13:26:55.595592 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:26:55.595546    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:27:11.931691 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:27:11.931648    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:27:27.221382 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:27:27.221346    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:27:36.787503 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:27:36.787474    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:27:36.792490 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:27:36.792469    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:27:46.215802 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:27:46.215768    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:27:54.917513 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:27:54.917476    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:28:03.315804 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:28:03.315691    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:28:15.131854 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:28:15.131809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:29:14.627972 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.627934    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f58c6bc67-6b6zz"]
Jul 23 13:29:14.628644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.628360    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca463c1-d6e8-4e83-b0e9-24d1074626a5" containerName="authorino"
Jul 23 13:29:14.628644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.628373    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca463c1-d6e8-4e83-b0e9-24d1074626a5" containerName="authorino"
Jul 23 13:29:14.628644 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.628449    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca463c1-d6e8-4e83-b0e9-24d1074626a5" containerName="authorino"
Jul 23 13:29:14.631582 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.631566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.639623 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.639599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58c6bc67-6b6zz"]
Jul 23 13:29:14.799423 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.799383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/775821b2-3a54-47ee-b363-58a48ebd9ace-tls-cert\") pod \"authorino-5f58c6bc67-6b6zz\" (UID: \"775821b2-3a54-47ee-b363-58a48ebd9ace\") " pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.799602 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.799437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbq6k\" (UniqueName: \"kubernetes.io/projected/775821b2-3a54-47ee-b363-58a48ebd9ace-kube-api-access-kbq6k\") pod \"authorino-5f58c6bc67-6b6zz\" (UID: \"775821b2-3a54-47ee-b363-58a48ebd9ace\") " pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.899968 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.899883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/775821b2-3a54-47ee-b363-58a48ebd9ace-tls-cert\") pod \"authorino-5f58c6bc67-6b6zz\" (UID: \"775821b2-3a54-47ee-b363-58a48ebd9ace\") " pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.899968 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.899934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbq6k\" (UniqueName: \"kubernetes.io/projected/775821b2-3a54-47ee-b363-58a48ebd9ace-kube-api-access-kbq6k\") pod \"authorino-5f58c6bc67-6b6zz\" (UID: \"775821b2-3a54-47ee-b363-58a48ebd9ace\") " pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.902426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.902407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/775821b2-3a54-47ee-b363-58a48ebd9ace-tls-cert\") pod \"authorino-5f58c6bc67-6b6zz\" (UID: \"775821b2-3a54-47ee-b363-58a48ebd9ace\") " pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.909203 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.909180    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbq6k\" (UniqueName: \"kubernetes.io/projected/775821b2-3a54-47ee-b363-58a48ebd9ace-kube-api-access-kbq6k\") pod \"authorino-5f58c6bc67-6b6zz\" (UID: \"775821b2-3a54-47ee-b363-58a48ebd9ace\") " pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:14.941155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:14.941123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f58c6bc67-6b6zz"
Jul 23 13:29:15.074211 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:15.074182    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f58c6bc67-6b6zz"]
Jul 23 13:29:15.076002 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:29:15.075968    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod775821b2_3a54_47ee_b363_58a48ebd9ace.slice/crio-01090425be60bd188b421fbf0c244999bc1647c44434b94d96635dcb939441d4 WatchSource:0}: Error finding container 01090425be60bd188b421fbf0c244999bc1647c44434b94d96635dcb939441d4: Status 404 returned error can't find the container with id 01090425be60bd188b421fbf0c244999bc1647c44434b94d96635dcb939441d4
Jul 23 13:29:15.077371 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:15.077353    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:29:15.418114 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:15.418066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58c6bc67-6b6zz" event={"ID":"775821b2-3a54-47ee-b363-58a48ebd9ace","Type":"ContainerStarted","Data":"01090425be60bd188b421fbf0c244999bc1647c44434b94d96635dcb939441d4"}
Jul 23 13:29:16.425652 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.425609    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f58c6bc67-6b6zz" event={"ID":"775821b2-3a54-47ee-b363-58a48ebd9ace","Type":"ContainerStarted","Data":"c6606e4c610bf9d1aa5b65a29f2a8bae53e2e00852cf545eab866334df6b31fe"}
Jul 23 13:29:16.451013 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.450953    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f58c6bc67-6b6zz" podStartSLOduration=2.012916616 podStartE2EDuration="2.450937244s" totalImagesPullingTime="438.020628ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:29:16.448375124 +0000 UTC m=+700.121240590" watchObservedRunningTime="2026-07-23 13:29:16.450937244 +0000 UTC m=+700.123802716"
Jul 23 13:29:16.528391 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.528355    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f8c58f774-7dpzk"]
Jul 23 13:29:16.528617 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.528588    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6f8c58f774-7dpzk" podUID="6436ffd7-8544-47e0-87a6-add94ce392c4" containerName="authorino" containerID="cri-o://3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0" gracePeriod=30
Jul 23 13:29:16.794171 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.794140    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:29:16.922356 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.922320    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6436ffd7-8544-47e0-87a6-add94ce392c4-tls-cert\") pod \"6436ffd7-8544-47e0-87a6-add94ce392c4\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") "
Jul 23 13:29:16.922539 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.922434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9m4v\" (UniqueName: \"kubernetes.io/projected/6436ffd7-8544-47e0-87a6-add94ce392c4-kube-api-access-f9m4v\") pod \"6436ffd7-8544-47e0-87a6-add94ce392c4\" (UID: \"6436ffd7-8544-47e0-87a6-add94ce392c4\") "
Jul 23 13:29:16.925247 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.925221    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6436ffd7-8544-47e0-87a6-add94ce392c4-kube-api-access-f9m4v" (OuterVolumeSpecName: "kube-api-access-f9m4v") pod "6436ffd7-8544-47e0-87a6-add94ce392c4" (UID: "6436ffd7-8544-47e0-87a6-add94ce392c4"). InnerVolumeSpecName "kube-api-access-f9m4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:29:16.933539 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:16.933518    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6436ffd7-8544-47e0-87a6-add94ce392c4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6436ffd7-8544-47e0-87a6-add94ce392c4" (UID: "6436ffd7-8544-47e0-87a6-add94ce392c4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:29:17.023814 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.023724    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9m4v\" (UniqueName: \"kubernetes.io/projected/6436ffd7-8544-47e0-87a6-add94ce392c4-kube-api-access-f9m4v\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:29:17.023814 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.023752    2581 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6436ffd7-8544-47e0-87a6-add94ce392c4-tls-cert\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:29:17.431884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.431848    2581 generic.go:356] "Generic (PLEG): container finished" podID="6436ffd7-8544-47e0-87a6-add94ce392c4" containerID="3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0" exitCode=0
Jul 23 13:29:17.432321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.431901    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8c58f774-7dpzk"
Jul 23 13:29:17.432321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.431938    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f8c58f774-7dpzk" event={"ID":"6436ffd7-8544-47e0-87a6-add94ce392c4","Type":"ContainerDied","Data":"3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0"}
Jul 23 13:29:17.432321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.431975    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f8c58f774-7dpzk" event={"ID":"6436ffd7-8544-47e0-87a6-add94ce392c4","Type":"ContainerDied","Data":"eb85068178e18ef10bee571ad39b1e6a710e4a7fb152dac297602c07acbf4d60"}
Jul 23 13:29:17.432321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.431993    2581 scope.go:117] "RemoveContainer" containerID="3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0"
Jul 23 13:29:17.441881 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.441853    2581 scope.go:117] "RemoveContainer" containerID="3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0"
Jul 23 13:29:17.442249 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:29:17.442186    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0\": container with ID starting with 3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0 not found: ID does not exist" containerID="3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0"
Jul 23 13:29:17.442249 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.442230    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0"} err="failed to get container status \"3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0\": rpc error: code = NotFound desc = could not find container \"3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0\": container with ID starting with 3a08d0d23cb4a194e4679ae119f974da326e6cc55d98617cc2e5e629056699a0 not found: ID does not exist"
Jul 23 13:29:17.464368 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.464337    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f8c58f774-7dpzk"]
Jul 23 13:29:17.468111 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:17.468067    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f8c58f774-7dpzk"]
Jul 23 13:29:18.817928 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:18.817894    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6436ffd7-8544-47e0-87a6-add94ce392c4" path="/var/lib/kubelet/pods/6436ffd7-8544-47e0-87a6-add94ce392c4/volumes"
Jul 23 13:29:48.627873 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:48.627833    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:29:58.826492 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:29:58.826461    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:30:09.626606 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:30:09.626569    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:31:52.318252 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:31:52.318214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:32:00.613769 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:00.613732    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:32:35.117234 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:35.117198    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:32:36.822343 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:36.822311    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:32:36.824027 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:36.824002    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:32:42.721460 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:42.721427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:32:53.710265 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:53.710227    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:32:59.917532 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:32:59.917494    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:33:10.219908 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:33:10.219876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:33:19.509375 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:33:19.509343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:33:32.325079 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:33:32.325047    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:33:41.218713 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:33:41.218672    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:34:03.617537 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:34:03.617459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:34:15.520739 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:34:15.520699    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:34:40.942914 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:34:40.942882    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:34:52.064151 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:34:52.064113    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:35:07.331901 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:35:07.331871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:35:18.522981 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:35:18.522944    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:35:28.126949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:35:28.126868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:35:37.725448 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:35:37.725413    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:35:47.019853 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:35:47.019811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:37:36.408287 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:37:36.408252    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:37:36.854129 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:37:36.854098    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:37:36.855460 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:37:36.855434    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:37:47.719994 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:37:47.719954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:37:56.427886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:37:56.427848    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:38:08.620811 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:38:08.620774    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:38:20.717072 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:38:20.717036    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:38:30.416929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:38:30.416832    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:38:40.527628 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:38:40.527593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:38:50.037008 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:38:50.036966    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:39:02.721316 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:39:02.721278    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:39:11.623021 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:39:11.622980    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:39:22.114123 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:39:22.114075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:39:46.708069 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:39:46.708035    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:39:54.319104 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:39:54.319057    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:40:05.924727 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:40:05.924643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:40:22.209264 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:40:22.209229    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:40:39.219246 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:40:39.219205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:40:53.816733 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:40:53.816690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:41:00.622341 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:41:00.622308    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:41:17.720133 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:41:17.720076    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:41:28.486545 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:41:28.486462    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:41:37.319456 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:41:37.319427    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:41:46.614066 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:41:46.614032    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:41:57.817252 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:41:57.817219    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:42:07.016560 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:07.016519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:42:20.432540 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:20.432506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:42:30.216022 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:30.215990    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:42:36.884605 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:36.884579    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:42:36.887484 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:36.887458    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:42:41.112082 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:41.112041    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:42:54.020046 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:42:54.020013    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:43:04.717189 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:43:04.717112    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:43:14.359901 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:43:14.359868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:43:25.557599 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:43:25.557563    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:43:38.323593 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:43:38.323560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:43:47.318497 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:43:47.318466    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:44:02.533585 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:02.533547    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:44:11.928478 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:11.928444    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:44:21.745933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:21.745903    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:44:25.011968 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.011940    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"]
Jul 23 13:44:25.012359 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.012345    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6436ffd7-8544-47e0-87a6-add94ce392c4" containerName="authorino"
Jul 23 13:44:25.012401 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.012360    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6436ffd7-8544-47e0-87a6-add94ce392c4" containerName="authorino"
Jul 23 13:44:25.012435 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.012427    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6436ffd7-8544-47e0-87a6-add94ce392c4" containerName="authorino"
Jul 23 13:44:25.015815 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.015799    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.018958 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.018936    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:44:25.018958 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.018949    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:44:25.019153 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.019037    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7d6a9a51-serving-cert\""
Jul 23 13:44:25.020294 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.020280    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:44:25.027599 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.027583    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"]
Jul 23 13:44:25.113963 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.113938    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4wg\" (UniqueName: \"kubernetes.io/projected/03696364-b615-42f1-a35c-0541c4a88350-kube-api-access-5s4wg\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.114071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.113972    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03696364-b615-42f1-a35c-0541c4a88350-openshift-service-ca\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.114071 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.114009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03696364-b615-42f1-a35c-0541c4a88350-maas-api-tls\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.214556 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.214530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03696364-b615-42f1-a35c-0541c4a88350-maas-api-tls\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.214633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.214592    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4wg\" (UniqueName: \"kubernetes.io/projected/03696364-b615-42f1-a35c-0541c4a88350-kube-api-access-5s4wg\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.214633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.214623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03696364-b615-42f1-a35c-0541c4a88350-openshift-service-ca\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.215263 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.215247    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03696364-b615-42f1-a35c-0541c4a88350-openshift-service-ca\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.217014 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.216995    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03696364-b615-42f1-a35c-0541c4a88350-maas-api-tls\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.227313 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.227294    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4wg\" (UniqueName: \"kubernetes.io/projected/03696364-b615-42f1-a35c-0541c4a88350-kube-api-access-5s4wg\") pod \"maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.327127 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.327059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:25.472530 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.472507    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"]
Jul 23 13:44:25.474111 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:44:25.474069    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03696364_b615_42f1_a35c_0541c4a88350.slice/crio-afdebcf48ae2e2cfe528d8d65ef84c78d5845f6c489963ad9ed61d9408b08afb WatchSource:0}: Error finding container afdebcf48ae2e2cfe528d8d65ef84c78d5845f6c489963ad9ed61d9408b08afb: Status 404 returned error can't find the container with id afdebcf48ae2e2cfe528d8d65ef84c78d5845f6c489963ad9ed61d9408b08afb
Jul 23 13:44:25.475441 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.475420    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:44:25.758037 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:25.758010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" event={"ID":"03696364-b615-42f1-a35c-0541c4a88350","Type":"ContainerStarted","Data":"afdebcf48ae2e2cfe528d8d65ef84c78d5845f6c489963ad9ed61d9408b08afb"}
Jul 23 13:44:27.770106 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:27.770060    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" event={"ID":"03696364-b615-42f1-a35c-0541c4a88350","Type":"ContainerStarted","Data":"66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b"}
Jul 23 13:44:27.770397 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:27.770124    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:33.117296 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:33.117201    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" podStartSLOduration=6.971375052 podStartE2EDuration="9.117186773s" totalImagesPullingTime="2.145811721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:44:27.787502571 +0000 UTC m=+1611.460368008" watchObservedRunningTime="2026-07-23 13:44:33.117186773 +0000 UTC m=+1616.790052217"
Jul 23 13:44:33.117727 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:33.117709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:44:33.779800 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:33.779772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:44:50.633568 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.633531    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"]
Jul 23 13:44:50.641636 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.641612    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:50.644228 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.644204    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"]
Jul 23 13:44:50.644649 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.644625    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:44:50.805579 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.805552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk\" (UID: \"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:50.905897 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.905839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk\" (UID: \"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:50.906459 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.906441    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk\" (UID: \"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:50.955272 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:50.955242    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:51.082955 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:51.082933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"]
Jul 23 13:44:51.085120 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:44:51.085079    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c84ce5_8fbf_41f7_9158_ae9682f0f25a.slice/crio-a1150736b11eb965725b30da5c6608df303e0c954f0a8dbb1dd60e2a449444f7 WatchSource:0}: Error finding container a1150736b11eb965725b30da5c6608df303e0c954f0a8dbb1dd60e2a449444f7: Status 404 returned error can't find the container with id a1150736b11eb965725b30da5c6608df303e0c954f0a8dbb1dd60e2a449444f7
Jul 23 13:44:51.885389 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:51.885363    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk" event={"ID":"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a","Type":"ContainerStarted","Data":"a1150736b11eb965725b30da5c6608df303e0c954f0a8dbb1dd60e2a449444f7"}
Jul 23 13:44:53.898879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:53.898856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk" event={"ID":"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a","Type":"ContainerStarted","Data":"911a9c8f29427ee508bed56085aee096a680b2b87929c4a1eede0e1383344984"}
Jul 23 13:44:54.904350 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:54.904316    2581 generic.go:356] "Generic (PLEG): container finished" podID="f1c84ce5-8fbf-41f7-9158-ae9682f0f25a" containerID="911a9c8f29427ee508bed56085aee096a680b2b87929c4a1eede0e1383344984" exitCode=0
Jul 23 13:44:54.904680 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:54.904403    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk" event={"ID":"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a","Type":"ContainerDied","Data":"911a9c8f29427ee508bed56085aee096a680b2b87929c4a1eede0e1383344984"}
Jul 23 13:44:56.033006 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.032984    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:56.149455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.149420    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a-maas-api-service-ca\") pod \"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a\" (UID: \"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a\") "
Jul 23 13:44:56.149732 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.149711    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1c84ce5-8fbf-41f7-9158-ae9682f0f25a" (UID: "f1c84ce5-8fbf-41f7-9158-ae9682f0f25a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:44:56.250503 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.250453    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:44:56.915065 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.915046    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"
Jul 23 13:44:56.915291 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.915039    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk" event={"ID":"f1c84ce5-8fbf-41f7-9158-ae9682f0f25a","Type":"ContainerDied","Data":"a1150736b11eb965725b30da5c6608df303e0c954f0a8dbb1dd60e2a449444f7"}
Jul 23 13:44:56.915291 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:44:56.915226    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1150736b11eb965725b30da5c6608df303e0c954f0a8dbb1dd60e2a449444f7"
Jul 23 13:45:00.144420 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.144387    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"]
Jul 23 13:45:00.144956 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.144939    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1c84ce5-8fbf-41f7-9158-ae9682f0f25a" containerName="revoke-keys"
Jul 23 13:45:00.145006 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.144960    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1c84ce5-8fbf-41f7-9158-ae9682f0f25a" containerName="revoke-keys"
Jul 23 13:45:00.145147 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.145134    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1c84ce5-8fbf-41f7-9158-ae9682f0f25a" containerName="revoke-keys"
Jul 23 13:45:00.148583 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.148568    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"]
Jul 23 13:45:00.148706 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.148691    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"
Jul 23 13:45:00.151664 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.151645    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:45:00.151878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.151863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"
Jul 23 13:45:00.156805 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.156748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"]
Jul 23 13:45:00.159061 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.159043    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"]
Jul 23 13:45:00.161277 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.161260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"
Jul 23 13:45:00.168988 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.168957    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"
Jul 23 13:45:00.518786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.518764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"]
Jul 23 13:45:00.521218 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:45:00.521193    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7368f280_2805_475c_9a0d_2fced95bc3ae.slice/crio-323a64ab43211818f225bfb816c904a5c6a4d1b12371eae76b01dfaac6a90694 WatchSource:0}: Error finding container 323a64ab43211818f225bfb816c904a5c6a4d1b12371eae76b01dfaac6a90694: Status 404 returned error can't find the container with id 323a64ab43211818f225bfb816c904a5c6a4d1b12371eae76b01dfaac6a90694
Jul 23 13:45:00.544280 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.544102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"]
Jul 23 13:45:00.934478 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.934446    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5" event={"ID":"6e28d964-4d32-4f8f-af64-1f100c587575","Type":"ContainerStarted","Data":"b65b03a3a2c2f41394671af36d6c1c222451548450d63a32d13ada924b9a53d6"}
Jul 23 13:45:00.934608 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.934506    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5" event={"ID":"6e28d964-4d32-4f8f-af64-1f100c587575","Type":"ContainerStarted","Data":"c0c11ea77b0ca9b9b768d04a9158ebd22a24d3a382e259560c97a8f2e3464d16"}
Jul 23 13:45:00.935801 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.935779    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t" event={"ID":"7368f280-2805-475c-9a0d-2fced95bc3ae","Type":"ContainerStarted","Data":"21be7ba8491c70b3742c2d1bce97cc341baa5e29b446650e3bf26f6a4b3c73bf"}
Jul 23 13:45:00.935902 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.935822    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t" event={"ID":"7368f280-2805-475c-9a0d-2fced95bc3ae","Type":"ContainerStarted","Data":"323a64ab43211818f225bfb816c904a5c6a4d1b12371eae76b01dfaac6a90694"}
Jul 23 13:45:00.952687 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.952645    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5" podStartSLOduration=0.952628055 podStartE2EDuration="952.628055ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:00.950143878 +0000 UTC m=+1644.623009317" watchObservedRunningTime="2026-07-23 13:45:00.952628055 +0000 UTC m=+1644.625493495"
Jul 23 13:45:00.967152 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:00.967115    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t" podStartSLOduration=0.96707965 podStartE2EDuration="967.07965ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:00.966531049 +0000 UTC m=+1644.639396492" watchObservedRunningTime="2026-07-23 13:45:00.96707965 +0000 UTC m=+1644.639945111"
Jul 23 13:45:01.208284 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:01.208257    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"]
Jul 23 13:45:01.208713 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:01.208441    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" podUID="03696364-b615-42f1-a35c-0541c4a88350" containerName="maas-api" containerID="cri-o://66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b" gracePeriod=30
Jul 23 13:45:01.269580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:01.269554    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"]
Jul 23 13:45:01.942989 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:01.942962    2581 generic.go:356] "Generic (PLEG): container finished" podID="7368f280-2805-475c-9a0d-2fced95bc3ae" containerID="21be7ba8491c70b3742c2d1bce97cc341baa5e29b446650e3bf26f6a4b3c73bf" exitCode=0
Jul 23 13:45:01.943168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:01.943052    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t" event={"ID":"7368f280-2805-475c-9a0d-2fced95bc3ae","Type":"ContainerDied","Data":"21be7ba8491c70b3742c2d1bce97cc341baa5e29b446650e3bf26f6a4b3c73bf"}
Jul 23 13:45:02.947454 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:02.947422    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5" podUID="6e28d964-4d32-4f8f-af64-1f100c587575" containerName="cleanup" containerID="cri-o://b65b03a3a2c2f41394671af36d6c1c222451548450d63a32d13ada924b9a53d6" gracePeriod=30
Jul 23 13:45:03.081846 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:03.081817    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"
Jul 23 13:45:03.775459 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:03.775426    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" podUID="03696364-b615-42f1-a35c-0541c4a88350" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.41:8443/health\": dial tcp 10.132.0.41:8443: connect: connection refused"
Jul 23 13:45:03.953884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:03.953852    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t"
Jul 23 13:45:03.953884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:03.953875    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746905-kcw7t" event={"ID":"7368f280-2805-475c-9a0d-2fced95bc3ae","Type":"ContainerDied","Data":"323a64ab43211818f225bfb816c904a5c6a4d1b12371eae76b01dfaac6a90694"}
Jul 23 13:45:03.954377 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:03.953910    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="323a64ab43211818f225bfb816c904a5c6a4d1b12371eae76b01dfaac6a90694"
Jul 23 13:45:04.317539 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:04.317519    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:45:05.739107 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:05.739061    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"]
Jul 23 13:45:05.744803 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:05.744779    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d6a9a51-v5zfk"]
Jul 23 13:45:06.753962 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.753941    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:45:06.817562 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.817485    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1c84ce5-8fbf-41f7-9158-ae9682f0f25a" path="/var/lib/kubelet/pods/f1c84ce5-8fbf-41f7-9158-ae9682f0f25a/volumes"
Jul 23 13:45:06.929353 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.929329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s4wg\" (UniqueName: \"kubernetes.io/projected/03696364-b615-42f1-a35c-0541c4a88350-kube-api-access-5s4wg\") pod \"03696364-b615-42f1-a35c-0541c4a88350\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") "
Jul 23 13:45:06.929495 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.929401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03696364-b615-42f1-a35c-0541c4a88350-openshift-service-ca\") pod \"03696364-b615-42f1-a35c-0541c4a88350\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") "
Jul 23 13:45:06.929495 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.929439    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03696364-b615-42f1-a35c-0541c4a88350-maas-api-tls\") pod \"03696364-b615-42f1-a35c-0541c4a88350\" (UID: \"03696364-b615-42f1-a35c-0541c4a88350\") "
Jul 23 13:45:06.929739 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.929717    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03696364-b615-42f1-a35c-0541c4a88350-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "03696364-b615-42f1-a35c-0541c4a88350" (UID: "03696364-b615-42f1-a35c-0541c4a88350"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:45:06.931618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.931596    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03696364-b615-42f1-a35c-0541c4a88350-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "03696364-b615-42f1-a35c-0541c4a88350" (UID: "03696364-b615-42f1-a35c-0541c4a88350"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:45:06.931727 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.931710    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03696364-b615-42f1-a35c-0541c4a88350-kube-api-access-5s4wg" (OuterVolumeSpecName: "kube-api-access-5s4wg") pod "03696364-b615-42f1-a35c-0541c4a88350" (UID: "03696364-b615-42f1-a35c-0541c4a88350"). InnerVolumeSpecName "kube-api-access-5s4wg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:45:06.970967 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.970944    2581 generic.go:356] "Generic (PLEG): container finished" podID="03696364-b615-42f1-a35c-0541c4a88350" containerID="66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b" exitCode=0
Jul 23 13:45:06.971061 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.970993    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"
Jul 23 13:45:06.971061 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.971027    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" event={"ID":"03696364-b615-42f1-a35c-0541c4a88350","Type":"ContainerDied","Data":"66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b"}
Jul 23 13:45:06.971173 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.971082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb" event={"ID":"03696364-b615-42f1-a35c-0541c4a88350","Type":"ContainerDied","Data":"afdebcf48ae2e2cfe528d8d65ef84c78d5845f6c489963ad9ed61d9408b08afb"}
Jul 23 13:45:06.971173 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.971138    2581 scope.go:117] "RemoveContainer" containerID="66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b"
Jul 23 13:45:06.980837 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.980817    2581 scope.go:117] "RemoveContainer" containerID="66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b"
Jul 23 13:45:06.981229 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:45:06.981125    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b\": container with ID starting with 66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b not found: ID does not exist" containerID="66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b"
Jul 23 13:45:06.981229 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:06.981164    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b"} err="failed to get container status \"66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b\": rpc error: code = NotFound desc = could not find container \"66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b\": container with ID starting with 66e42c890f993849d1e78f4a321658d30788766dc2e934a594f3a0f79a92a87b not found: ID does not exist"
Jul 23 13:45:07.019884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:07.019862    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"]
Jul 23 13:45:07.030124 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:07.030083    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s4wg\" (UniqueName: \"kubernetes.io/projected/03696364-b615-42f1-a35c-0541c4a88350-kube-api-access-5s4wg\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:07.030215 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:07.030125    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/03696364-b615-42f1-a35c-0541c4a88350-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:07.030215 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:07.030136    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/03696364-b615-42f1-a35c-0541c4a88350-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:07.045735 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:07.045705    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7d6a9a51-774d495c5-2cbpb"]
Jul 23 13:45:08.817388 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:08.817358    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03696364-b615-42f1-a35c-0541c4a88350" path="/var/lib/kubelet/pods/03696364-b615-42f1-a35c-0541c4a88350/volumes"
Jul 23 13:45:09.336329 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336301    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"]
Jul 23 13:45:09.336716 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336702    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7368f280-2805-475c-9a0d-2fced95bc3ae" containerName="cleanup"
Jul 23 13:45:09.336781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336718    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7368f280-2805-475c-9a0d-2fced95bc3ae" containerName="cleanup"
Jul 23 13:45:09.336781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336735    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03696364-b615-42f1-a35c-0541c4a88350" containerName="maas-api"
Jul 23 13:45:09.336781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336741    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="03696364-b615-42f1-a35c-0541c4a88350" containerName="maas-api"
Jul 23 13:45:09.336935 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336808    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7368f280-2805-475c-9a0d-2fced95bc3ae" containerName="cleanup"
Jul 23 13:45:09.336935 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.336818    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="03696364-b615-42f1-a35c-0541c4a88350" containerName="maas-api"
Jul 23 13:45:09.341479 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.341460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.344509 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.344490    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:45:09.344509 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.344501    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:45:09.345623 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.345604    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-38128cd5-serving-cert\""
Jul 23 13:45:09.345736 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.345637    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:45:09.351320 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.351297    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"]
Jul 23 13:45:09.446968 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.446948    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.447079 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.446980    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96df4e0f-7d62-4484-9aef-3cd8c1c62073-openshift-service-ca\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.447079 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.447016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fg89\" (UniqueName: \"kubernetes.io/projected/96df4e0f-7d62-4484-9aef-3cd8c1c62073-kube-api-access-5fg89\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.547524 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.547500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.547610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.547529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96df4e0f-7d62-4484-9aef-3cd8c1c62073-openshift-service-ca\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.547610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.547564    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fg89\" (UniqueName: \"kubernetes.io/projected/96df4e0f-7d62-4484-9aef-3cd8c1c62073-kube-api-access-5fg89\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.547733 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:45:09.547640    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-serving-cert: secret "maas-api-e2e-migrate-38128cd5-serving-cert" not found
Jul 23 13:45:09.547733 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:45:09.547716    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls podName:96df4e0f-7d62-4484-9aef-3cd8c1c62073 nodeName:}" failed. No retries permitted until 2026-07-23 13:45:10.047698103 +0000 UTC m=+1653.720563521 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls") pod "maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" (UID: "96df4e0f-7d62-4484-9aef-3cd8c1c62073") : secret "maas-api-e2e-migrate-38128cd5-serving-cert" not found
Jul 23 13:45:09.548139 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.548122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96df4e0f-7d62-4484-9aef-3cd8c1c62073-openshift-service-ca\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:09.561109 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:09.561077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fg89\" (UniqueName: \"kubernetes.io/projected/96df4e0f-7d62-4484-9aef-3cd8c1c62073-kube-api-access-5fg89\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:10.051330 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.051301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:10.053713 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.053695    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls\") pod \"maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:10.252663 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.252630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:10.387164 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.387142    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"]
Jul 23 13:45:10.389337 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:45:10.389312    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96df4e0f_7d62_4484_9aef_3cd8c1c62073.slice/crio-367e17bb3cbca78fb9294805d5fe507a87d3932b5aea5b006e28b63ad574cdb4 WatchSource:0}: Error finding container 367e17bb3cbca78fb9294805d5fe507a87d3932b5aea5b006e28b63ad574cdb4: Status 404 returned error can't find the container with id 367e17bb3cbca78fb9294805d5fe507a87d3932b5aea5b006e28b63ad574cdb4
Jul 23 13:45:10.992066 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.991993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" event={"ID":"96df4e0f-7d62-4484-9aef-3cd8c1c62073","Type":"ContainerStarted","Data":"16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f"}
Jul 23 13:45:10.992066 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.992050    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" event={"ID":"96df4e0f-7d62-4484-9aef-3cd8c1c62073","Type":"ContainerStarted","Data":"367e17bb3cbca78fb9294805d5fe507a87d3932b5aea5b006e28b63ad574cdb4"}
Jul 23 13:45:10.992258 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:10.992112    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:11.024745 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:11.024700    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" podStartSLOduration=1.682309552 podStartE2EDuration="2.024685573s" totalImagesPullingTime="342.376021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:11.023254758 +0000 UTC m=+1654.696120198" watchObservedRunningTime="2026-07-23 13:45:11.024685573 +0000 UTC m=+1654.697551006"
Jul 23 13:45:16.116430 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:16.116395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:45:17.002764 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:17.002737    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:33.096226 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:33.096197    2581 generic.go:356] "Generic (PLEG): container finished" podID="6e28d964-4d32-4f8f-af64-1f100c587575" containerID="b65b03a3a2c2f41394671af36d6c1c222451548450d63a32d13ada924b9a53d6" exitCode=137
Jul 23 13:45:33.096667 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:33.096234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5" event={"ID":"6e28d964-4d32-4f8f-af64-1f100c587575","Type":"ContainerDied","Data":"b65b03a3a2c2f41394671af36d6c1c222451548450d63a32d13ada924b9a53d6"}
Jul 23 13:45:33.138429 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:33.138409    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"
Jul 23 13:45:34.101658 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.101630    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"
Jul 23 13:45:34.102018 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.101669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5" event={"ID":"6e28d964-4d32-4f8f-af64-1f100c587575","Type":"ContainerDied","Data":"c0c11ea77b0ca9b9b768d04a9158ebd22a24d3a382e259560c97a8f2e3464d16"}
Jul 23 13:45:34.102018 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.101723    2581 scope.go:117] "RemoveContainer" containerID="b65b03a3a2c2f41394671af36d6c1c222451548450d63a32d13ada924b9a53d6"
Jul 23 13:45:34.122657 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.122631    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"]
Jul 23 13:45:34.125989 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.125970    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-7d6a9a51-29746905-5nlp5"]
Jul 23 13:45:34.333824 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.333801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"]
Jul 23 13:45:34.334199 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.334186    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e28d964-4d32-4f8f-af64-1f100c587575" containerName="cleanup"
Jul 23 13:45:34.334199 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.334199    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e28d964-4d32-4f8f-af64-1f100c587575" containerName="cleanup"
Jul 23 13:45:34.334290 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.334277    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e28d964-4d32-4f8f-af64-1f100c587575" containerName="cleanup"
Jul 23 13:45:34.338675 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.338661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:34.341472 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.341440    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:45:34.344190 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.344172    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"]
Jul 23 13:45:34.437395 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.437371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd\" (UID: \"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:34.538651 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.538633    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd\" (UID: \"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:34.539224 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.539206    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd\" (UID: \"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:34.649274 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.649251    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:34.777719 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.777697    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"]
Jul 23 13:45:34.779536 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:45:34.779509    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f7f5997_a7a6_4d23_a2dc_e45b0c412b70.slice/crio-bb29692304eca4ca1120630a8af2e87d6fed1316c832972318d092fe544f71fd WatchSource:0}: Error finding container bb29692304eca4ca1120630a8af2e87d6fed1316c832972318d092fe544f71fd: Status 404 returned error can't find the container with id bb29692304eca4ca1120630a8af2e87d6fed1316c832972318d092fe544f71fd
Jul 23 13:45:34.818038 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:34.818017    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e28d964-4d32-4f8f-af64-1f100c587575" path="/var/lib/kubelet/pods/6e28d964-4d32-4f8f-af64-1f100c587575/volumes"
Jul 23 13:45:35.114544 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:35.114517    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd" event={"ID":"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70","Type":"ContainerStarted","Data":"bb29692304eca4ca1120630a8af2e87d6fed1316c832972318d092fe544f71fd"}
Jul 23 13:45:36.121883 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:36.121843    2581 generic.go:356] "Generic (PLEG): container finished" podID="7f7f5997-a7a6-4d23-a2dc-e45b0c412b70" containerID="1e3cb1854e90927c9fb26c1528e4aa875a50f02c40653d2466437cfc897c833d" exitCode=0
Jul 23 13:45:36.122298 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:36.121926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd" event={"ID":"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70","Type":"ContainerDied","Data":"1e3cb1854e90927c9fb26c1528e4aa875a50f02c40653d2466437cfc897c833d"}
Jul 23 13:45:37.250076 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:37.250055    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:37.362593 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:37.362555    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70-maas-api-service-ca\") pod \"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70\" (UID: \"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70\") "
Jul 23 13:45:37.362884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:37.362863    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7f7f5997-a7a6-4d23-a2dc-e45b0c412b70" (UID: "7f7f5997-a7a6-4d23-a2dc-e45b0c412b70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:45:37.463282 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:37.463257    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:38.131759 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:38.131735    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd" event={"ID":"7f7f5997-a7a6-4d23-a2dc-e45b0c412b70","Type":"ContainerDied","Data":"bb29692304eca4ca1120630a8af2e87d6fed1316c832972318d092fe544f71fd"}
Jul 23 13:45:38.131898 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:38.131776    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb29692304eca4ca1120630a8af2e87d6fed1316c832972318d092fe544f71fd"
Jul 23 13:45:38.131898 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:38.131745    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"
Jul 23 13:45:44.925781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:44.925751    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"]
Jul 23 13:45:44.926170 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:44.925942    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" podUID="96df4e0f-7d62-4484-9aef-3cd8c1c62073" containerName="maas-api" containerID="cri-o://16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f" gracePeriod=30
Jul 23 13:45:45.164660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.164637    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:45.170688 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.170662    2581 generic.go:356] "Generic (PLEG): container finished" podID="96df4e0f-7d62-4484-9aef-3cd8c1c62073" containerID="16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f" exitCode=0
Jul 23 13:45:45.170776 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.170696    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"
Jul 23 13:45:45.170776 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.170756    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" event={"ID":"96df4e0f-7d62-4484-9aef-3cd8c1c62073","Type":"ContainerDied","Data":"16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f"}
Jul 23 13:45:45.170843 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.170797    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8" event={"ID":"96df4e0f-7d62-4484-9aef-3cd8c1c62073","Type":"ContainerDied","Data":"367e17bb3cbca78fb9294805d5fe507a87d3932b5aea5b006e28b63ad574cdb4"}
Jul 23 13:45:45.170843 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.170817    2581 scope.go:117] "RemoveContainer" containerID="16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f"
Jul 23 13:45:45.178846 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.178831    2581 scope.go:117] "RemoveContainer" containerID="16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f"
Jul 23 13:45:45.179110 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:45:45.179070    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f\": container with ID starting with 16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f not found: ID does not exist" containerID="16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f"
Jul 23 13:45:45.179169 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.179131    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f"} err="failed to get container status \"16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f\": rpc error: code = NotFound desc = could not find container \"16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f\": container with ID starting with 16009ed0e9a4b7646dc1538c54a4c9f7675763d9face862880490e490b2adb3f not found: ID does not exist"
Jul 23 13:45:45.221269 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.221246    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls\") pod \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") "
Jul 23 13:45:45.221369 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.221280    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fg89\" (UniqueName: \"kubernetes.io/projected/96df4e0f-7d62-4484-9aef-3cd8c1c62073-kube-api-access-5fg89\") pod \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") "
Jul 23 13:45:45.221414 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.221382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96df4e0f-7d62-4484-9aef-3cd8c1c62073-openshift-service-ca\") pod \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\" (UID: \"96df4e0f-7d62-4484-9aef-3cd8c1c62073\") "
Jul 23 13:45:45.221720 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.221696    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96df4e0f-7d62-4484-9aef-3cd8c1c62073-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96df4e0f-7d62-4484-9aef-3cd8c1c62073" (UID: "96df4e0f-7d62-4484-9aef-3cd8c1c62073"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:45:45.223283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.223262    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96df4e0f-7d62-4484-9aef-3cd8c1c62073" (UID: "96df4e0f-7d62-4484-9aef-3cd8c1c62073"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:45:45.223380 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.223334    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96df4e0f-7d62-4484-9aef-3cd8c1c62073-kube-api-access-5fg89" (OuterVolumeSpecName: "kube-api-access-5fg89") pod "96df4e0f-7d62-4484-9aef-3cd8c1c62073" (UID: "96df4e0f-7d62-4484-9aef-3cd8c1c62073"). InnerVolumeSpecName "kube-api-access-5fg89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:45:45.322449 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.322427    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96df4e0f-7d62-4484-9aef-3cd8c1c62073-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:45.322449 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.322445    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96df4e0f-7d62-4484-9aef-3cd8c1c62073-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:45.322567 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.322455    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fg89\" (UniqueName: \"kubernetes.io/projected/96df4e0f-7d62-4484-9aef-3cd8c1c62073-kube-api-access-5fg89\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:45:45.492868 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.492844    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"]
Jul 23 13:45:45.497605 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:45.497587    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-38128cd5-85dcfffbb6-t25b8"]
Jul 23 13:45:46.818136 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:46.818106    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96df4e0f-7d62-4484-9aef-3cd8c1c62073" path="/var/lib/kubelet/pods/96df4e0f-7d62-4484-9aef-3cd8c1c62073/volumes"
Jul 23 13:45:47.721930 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:47.721888    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:45:49.416110 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:49.416061    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"]
Jul 23 13:45:49.417721 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:49.417699    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-38128cd5-p7rsd"]
Jul 23 13:45:50.817256 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:50.817227    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f7f5997-a7a6-4d23-a2dc-e45b0c412b70" path="/var/lib/kubelet/pods/7f7f5997-a7a6-4d23-a2dc-e45b0c412b70/volumes"
Jul 23 13:45:53.587662 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.587625    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"]
Jul 23 13:45:53.588280 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.588262    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f7f5997-a7a6-4d23-a2dc-e45b0c412b70" containerName="revoke-keys"
Jul 23 13:45:53.588359 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.588284    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f7f5997-a7a6-4d23-a2dc-e45b0c412b70" containerName="revoke-keys"
Jul 23 13:45:53.588359 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.588326    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96df4e0f-7d62-4484-9aef-3cd8c1c62073" containerName="maas-api"
Jul 23 13:45:53.588359 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.588335    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="96df4e0f-7d62-4484-9aef-3cd8c1c62073" containerName="maas-api"
Jul 23 13:45:53.588453 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.588422    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="96df4e0f-7d62-4484-9aef-3cd8c1c62073" containerName="maas-api"
Jul 23 13:45:53.588453 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.588438    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f7f5997-a7a6-4d23-a2dc-e45b0c412b70" containerName="revoke-keys"
Jul 23 13:45:53.593635 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.593609    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.597886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.597864    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:45:53.598196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.598180    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:45:53.599328 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.599308    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:45:53.599428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.599310    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-698a9d15-serving-cert\""
Jul 23 13:45:53.606361 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.606341    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"]
Jul 23 13:45:53.684664 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.684641    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8tn\" (UniqueName: \"kubernetes.io/projected/df0a4f79-6ce8-4232-84f3-592e3cdeb202-kube-api-access-9k8tn\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.684758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.684687    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.684799 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.684759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0a4f79-6ce8-4232-84f3-592e3cdeb202-openshift-service-ca\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.785141 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.785080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.785238 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:45:53.785168    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-serving-cert: secret "maas-api-e2e-ait-698a9d15-serving-cert" not found
Jul 23 13:45:53.785238 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:45:53.785227    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls podName:df0a4f79-6ce8-4232-84f3-592e3cdeb202 nodeName:}" failed. No retries permitted until 2026-07-23 13:45:54.285213129 +0000 UTC m=+1697.958078560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls") pod "maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" (UID: "df0a4f79-6ce8-4232-84f3-592e3cdeb202") : secret "maas-api-e2e-ait-698a9d15-serving-cert" not found
Jul 23 13:45:53.785333 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.785170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0a4f79-6ce8-4232-84f3-592e3cdeb202-openshift-service-ca\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.785333 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.785295    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8tn\" (UniqueName: \"kubernetes.io/projected/df0a4f79-6ce8-4232-84f3-592e3cdeb202-kube-api-access-9k8tn\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.785700 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.785682    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0a4f79-6ce8-4232-84f3-592e3cdeb202-openshift-service-ca\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:53.799961 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:53.799942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8tn\" (UniqueName: \"kubernetes.io/projected/df0a4f79-6ce8-4232-84f3-592e3cdeb202-kube-api-access-9k8tn\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:54.289790 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:54.289762    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:54.292310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:54.292289    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls\") pod \"maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:54.504610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:54.504587    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:54.637116 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:54.637074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"]
Jul 23 13:45:54.638145 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:45:54.638121    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0a4f79_6ce8_4232_84f3_592e3cdeb202.slice/crio-ea63fb64d3810aaaa6cd0637cfebbeb1dc97b96dd284b48f121c6fba3cbdd591 WatchSource:0}: Error finding container ea63fb64d3810aaaa6cd0637cfebbeb1dc97b96dd284b48f121c6fba3cbdd591: Status 404 returned error can't find the container with id ea63fb64d3810aaaa6cd0637cfebbeb1dc97b96dd284b48f121c6fba3cbdd591
Jul 23 13:45:55.224686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:55.224659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" event={"ID":"df0a4f79-6ce8-4232-84f3-592e3cdeb202","Type":"ContainerStarted","Data":"f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891"}
Jul 23 13:45:55.224806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:55.224710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" event={"ID":"df0a4f79-6ce8-4232-84f3-592e3cdeb202","Type":"ContainerStarted","Data":"ea63fb64d3810aaaa6cd0637cfebbeb1dc97b96dd284b48f121c6fba3cbdd591"}
Jul 23 13:45:55.224806 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:55.224785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:45:55.246407 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:55.246368    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" podStartSLOduration=1.804840604 podStartE2EDuration="2.246354902s" totalImagesPullingTime="441.514298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:45:55.24383948 +0000 UTC m=+1698.916704921" watchObservedRunningTime="2026-07-23 13:45:55.246354902 +0000 UTC m=+1698.919220344"
Jul 23 13:45:58.914488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:45:58.914299    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:46:01.235194 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:01.235171    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:46:19.383149 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.383122    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"]
Jul 23 13:46:19.386660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.386643    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:19.389922 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.389903    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:46:19.395118 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.395074    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"]
Jul 23 13:46:19.474922 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.474899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8feccf2a-edb3-4ebe-add7-4f822924ea01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-698a9d15-m579s\" (UID: \"8feccf2a-edb3-4ebe-add7-4f822924ea01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:19.576301 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.576267    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8feccf2a-edb3-4ebe-add7-4f822924ea01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-698a9d15-m579s\" (UID: \"8feccf2a-edb3-4ebe-add7-4f822924ea01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:19.576817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.576799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8feccf2a-edb3-4ebe-add7-4f822924ea01-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-698a9d15-m579s\" (UID: \"8feccf2a-edb3-4ebe-add7-4f822924ea01\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:19.698197 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.698141    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:19.827618 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:19.827593    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"]
Jul 23 13:46:19.829684 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:46:19.829660    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8feccf2a_edb3_4ebe_add7_4f822924ea01.slice/crio-3e36971c9f070316e37e771f068e804c8cb9df266be90342df56a4d2ad563a73 WatchSource:0}: Error finding container 3e36971c9f070316e37e771f068e804c8cb9df266be90342df56a4d2ad563a73: Status 404 returned error can't find the container with id 3e36971c9f070316e37e771f068e804c8cb9df266be90342df56a4d2ad563a73
Jul 23 13:46:20.341044 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:20.340980    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s" event={"ID":"8feccf2a-edb3-4ebe-add7-4f822924ea01","Type":"ContainerStarted","Data":"dedce98d4ea10f53d8d1321d9b2a0b240a73e119e85ad25761745e67dca6e3dc"}
Jul 23 13:46:20.341044 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:20.341024    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s" event={"ID":"8feccf2a-edb3-4ebe-add7-4f822924ea01","Type":"ContainerStarted","Data":"3e36971c9f070316e37e771f068e804c8cb9df266be90342df56a4d2ad563a73"}
Jul 23 13:46:20.357455 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:20.357421    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s" podStartSLOduration=1.357407907 podStartE2EDuration="1.357407907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:20.356148268 +0000 UTC m=+1724.029013705" watchObservedRunningTime="2026-07-23 13:46:20.357407907 +0000 UTC m=+1724.030273343"
Jul 23 13:46:21.346734 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:21.346701    2581 generic.go:356] "Generic (PLEG): container finished" podID="8feccf2a-edb3-4ebe-add7-4f822924ea01" containerID="dedce98d4ea10f53d8d1321d9b2a0b240a73e119e85ad25761745e67dca6e3dc" exitCode=0
Jul 23 13:46:21.347110 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:21.346736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s" event={"ID":"8feccf2a-edb3-4ebe-add7-4f822924ea01","Type":"ContainerDied","Data":"dedce98d4ea10f53d8d1321d9b2a0b240a73e119e85ad25761745e67dca6e3dc"}
Jul 23 13:46:22.480964 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:22.480937    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:22.599933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:22.599910    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8feccf2a-edb3-4ebe-add7-4f822924ea01-maas-api-service-ca\") pod \"8feccf2a-edb3-4ebe-add7-4f822924ea01\" (UID: \"8feccf2a-edb3-4ebe-add7-4f822924ea01\") "
Jul 23 13:46:22.600244 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:22.600225    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8feccf2a-edb3-4ebe-add7-4f822924ea01-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8feccf2a-edb3-4ebe-add7-4f822924ea01" (UID: "8feccf2a-edb3-4ebe-add7-4f822924ea01"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:46:22.701432 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:22.701409    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8feccf2a-edb3-4ebe-add7-4f822924ea01-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:46:23.357847 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:23.357825    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"
Jul 23 13:46:23.357995 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:23.357849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s" event={"ID":"8feccf2a-edb3-4ebe-add7-4f822924ea01","Type":"ContainerDied","Data":"3e36971c9f070316e37e771f068e804c8cb9df266be90342df56a4d2ad563a73"}
Jul 23 13:46:23.357995 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:23.357891    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e36971c9f070316e37e771f068e804c8cb9df266be90342df56a4d2ad563a73"
Jul 23 13:46:29.866177 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:29.866150    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"]
Jul 23 13:46:29.866666 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:29.866338    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" podUID="df0a4f79-6ce8-4232-84f3-592e3cdeb202" containerName="maas-api" containerID="cri-o://f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891" gracePeriod=30
Jul 23 13:46:30.111746 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.111720    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:46:30.253862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.253830    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k8tn\" (UniqueName: \"kubernetes.io/projected/df0a4f79-6ce8-4232-84f3-592e3cdeb202-kube-api-access-9k8tn\") pod \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") "
Jul 23 13:46:30.253862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.253865    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls\") pod \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") "
Jul 23 13:46:30.254108 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.253951    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0a4f79-6ce8-4232-84f3-592e3cdeb202-openshift-service-ca\") pod \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\" (UID: \"df0a4f79-6ce8-4232-84f3-592e3cdeb202\") "
Jul 23 13:46:30.254350 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.254328    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df0a4f79-6ce8-4232-84f3-592e3cdeb202-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df0a4f79-6ce8-4232-84f3-592e3cdeb202" (UID: "df0a4f79-6ce8-4232-84f3-592e3cdeb202"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:46:30.256016 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.255992    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0a4f79-6ce8-4232-84f3-592e3cdeb202-kube-api-access-9k8tn" (OuterVolumeSpecName: "kube-api-access-9k8tn") pod "df0a4f79-6ce8-4232-84f3-592e3cdeb202" (UID: "df0a4f79-6ce8-4232-84f3-592e3cdeb202"). InnerVolumeSpecName "kube-api-access-9k8tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:46:30.256076 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.256000    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df0a4f79-6ce8-4232-84f3-592e3cdeb202" (UID: "df0a4f79-6ce8-4232-84f3-592e3cdeb202"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:46:30.355487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.355464    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df0a4f79-6ce8-4232-84f3-592e3cdeb202-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:46:30.355487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.355485    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k8tn\" (UniqueName: \"kubernetes.io/projected/df0a4f79-6ce8-4232-84f3-592e3cdeb202-kube-api-access-9k8tn\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:46:30.355614 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.355495    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df0a4f79-6ce8-4232-84f3-592e3cdeb202-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:46:30.401041 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.401018    2581 generic.go:356] "Generic (PLEG): container finished" podID="df0a4f79-6ce8-4232-84f3-592e3cdeb202" containerID="f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891" exitCode=0
Jul 23 13:46:30.401168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.401046    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" event={"ID":"df0a4f79-6ce8-4232-84f3-592e3cdeb202","Type":"ContainerDied","Data":"f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891"}
Jul 23 13:46:30.401168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.401069    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"
Jul 23 13:46:30.401168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.401122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn" event={"ID":"df0a4f79-6ce8-4232-84f3-592e3cdeb202","Type":"ContainerDied","Data":"ea63fb64d3810aaaa6cd0637cfebbeb1dc97b96dd284b48f121c6fba3cbdd591"}
Jul 23 13:46:30.401168 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.401151    2581 scope.go:117] "RemoveContainer" containerID="f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891"
Jul 23 13:46:30.415876 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.415856    2581 scope.go:117] "RemoveContainer" containerID="f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891"
Jul 23 13:46:30.416166 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:46:30.416144    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891\": container with ID starting with f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891 not found: ID does not exist" containerID="f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891"
Jul 23 13:46:30.416240 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.416174    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891"} err="failed to get container status \"f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891\": rpc error: code = NotFound desc = could not find container \"f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891\": container with ID starting with f15ed0e7a071f82094691f7346554168320885c3b58dfcc8c1ed70c9acbb2891 not found: ID does not exist"
Jul 23 13:46:30.426786 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.426758    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"]
Jul 23 13:46:30.432184 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.432165    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-698a9d15-76b465f7d8-2f8kn"]
Jul 23 13:46:30.817982 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:30.817958    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0a4f79-6ce8-4232-84f3-592e3cdeb202" path="/var/lib/kubelet/pods/df0a4f79-6ce8-4232-84f3-592e3cdeb202/volumes"
Jul 23 13:46:32.533055 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:32.533020    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:46:34.459747 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:34.459716    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"]
Jul 23 13:46:34.462534 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:34.462510    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-698a9d15-m579s"]
Jul 23 13:46:34.817801 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:34.817738    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8feccf2a-edb3-4ebe-add7-4f822924ea01" path="/var/lib/kubelet/pods/8feccf2a-edb3-4ebe-add7-4f822924ea01/volumes"
Jul 23 13:46:38.746551 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746522    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"]
Jul 23 13:46:38.746886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746875    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8feccf2a-edb3-4ebe-add7-4f822924ea01" containerName="revoke-keys"
Jul 23 13:46:38.746886 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746885    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8feccf2a-edb3-4ebe-add7-4f822924ea01" containerName="revoke-keys"
Jul 23 13:46:38.746956 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746899    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0a4f79-6ce8-4232-84f3-592e3cdeb202" containerName="maas-api"
Jul 23 13:46:38.746956 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746904    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0a4f79-6ce8-4232-84f3-592e3cdeb202" containerName="maas-api"
Jul 23 13:46:38.747019 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746980    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0a4f79-6ce8-4232-84f3-592e3cdeb202" containerName="maas-api"
Jul 23 13:46:38.747019 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.746987    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8feccf2a-edb3-4ebe-add7-4f822924ea01" containerName="revoke-keys"
Jul 23 13:46:38.749879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.749863    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.753218 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.753194    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:46:38.753347 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.753324    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-dceaf465-serving-cert\""
Jul 23 13:46:38.753425 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.753413    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:46:38.754619 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.754595    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:46:38.760981 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.760958    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"]
Jul 23 13:46:38.822177 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.822144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56279a52-657c-4d5f-a0b0-f2f976b294a9-openshift-service-ca\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.822312 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.822261    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.822312 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.822296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vttm\" (UniqueName: \"kubernetes.io/projected/56279a52-657c-4d5f-a0b0-f2f976b294a9-kube-api-access-4vttm\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.923513 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.923475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.923659 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.923524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vttm\" (UniqueName: \"kubernetes.io/projected/56279a52-657c-4d5f-a0b0-f2f976b294a9-kube-api-access-4vttm\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.923659 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.923579    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56279a52-657c-4d5f-a0b0-f2f976b294a9-openshift-service-ca\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.923659 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:46:38.923618    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-serving-cert: secret "maas-api-e2e-derive-dceaf465-serving-cert" not found
Jul 23 13:46:38.923825 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:46:38.923676    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls podName:56279a52-657c-4d5f-a0b0-f2f976b294a9 nodeName:}" failed. No retries permitted until 2026-07-23 13:46:39.423661507 +0000 UTC m=+1743.096526926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls") pod "maas-api-e2e-derive-dceaf465-8454454-pz7vh" (UID: "56279a52-657c-4d5f-a0b0-f2f976b294a9") : secret "maas-api-e2e-derive-dceaf465-serving-cert" not found
Jul 23 13:46:38.924252 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.924232    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56279a52-657c-4d5f-a0b0-f2f976b294a9-openshift-service-ca\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:38.936024 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:38.933194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vttm\" (UniqueName: \"kubernetes.io/projected/56279a52-657c-4d5f-a0b0-f2f976b294a9-kube-api-access-4vttm\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:39.426488 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:39.426464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:39.428812 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:39.428793    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls\") pod \"maas-api-e2e-derive-dceaf465-8454454-pz7vh\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:39.660314 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:39.660290    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:39.790692 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:39.790670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"]
Jul 23 13:46:39.792358 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:46:39.792326    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56279a52_657c_4d5f_a0b0_f2f976b294a9.slice/crio-e0204032c0dd5d604395b79219641f2874961569cf99d2a99f81a1d3584e9142 WatchSource:0}: Error finding container e0204032c0dd5d604395b79219641f2874961569cf99d2a99f81a1d3584e9142: Status 404 returned error can't find the container with id e0204032c0dd5d604395b79219641f2874961569cf99d2a99f81a1d3584e9142
Jul 23 13:46:40.450363 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:40.450330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh" event={"ID":"56279a52-657c-4d5f-a0b0-f2f976b294a9","Type":"ContainerStarted","Data":"e0204032c0dd5d604395b79219641f2874961569cf99d2a99f81a1d3584e9142"}
Jul 23 13:46:41.456642 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:41.456604    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh" event={"ID":"56279a52-657c-4d5f-a0b0-f2f976b294a9","Type":"ContainerStarted","Data":"211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a"}
Jul 23 13:46:41.456983 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:41.456685    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:46:41.475796 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:41.475752    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh" podStartSLOduration=2.35058919 podStartE2EDuration="3.475738789s" totalImagesPullingTime="1.125149599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:46:41.474756683 +0000 UTC m=+1745.147622311" watchObservedRunningTime="2026-07-23 13:46:41.475738789 +0000 UTC m=+1745.148604228"
Jul 23 13:46:45.022599 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:45.022566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:46:47.468566 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:46:47.468514    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:47:03.603754 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.603721    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"]
Jul 23 13:47:03.607426 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.607406    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:03.610459 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.610443    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:47:03.619681 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.619662    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"]
Jul 23 13:47:03.717025 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.716993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f45241-f52e-4823-b209-3dea5346b8c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f\" (UID: \"a4f45241-f52e-4823-b209-3dea5346b8c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:03.817541 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.817517    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f45241-f52e-4823-b209-3dea5346b8c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f\" (UID: \"a4f45241-f52e-4823-b209-3dea5346b8c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:03.818050 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.818033    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f45241-f52e-4823-b209-3dea5346b8c2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f\" (UID: \"a4f45241-f52e-4823-b209-3dea5346b8c2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:03.917839 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:03.917819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:04.067262 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:04.067237    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"]
Jul 23 13:47:04.068855 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:47:04.068826    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4f45241_f52e_4823_b209_3dea5346b8c2.slice/crio-70c282d79acfba3367493e90897a8df12f7ebd8d99a8a15718c992d6a2064fca WatchSource:0}: Error finding container 70c282d79acfba3367493e90897a8df12f7ebd8d99a8a15718c992d6a2064fca: Status 404 returned error can't find the container with id 70c282d79acfba3367493e90897a8df12f7ebd8d99a8a15718c992d6a2064fca
Jul 23 13:47:04.576489 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:04.576425    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f" event={"ID":"a4f45241-f52e-4823-b209-3dea5346b8c2","Type":"ContainerStarted","Data":"e62f83993b4cc88313d11bff2df53537d513169705eef8becde08e33ea6991c3"}
Jul 23 13:47:04.576489 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:04.576475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f" event={"ID":"a4f45241-f52e-4823-b209-3dea5346b8c2","Type":"ContainerStarted","Data":"70c282d79acfba3367493e90897a8df12f7ebd8d99a8a15718c992d6a2064fca"}
Jul 23 13:47:04.595534 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:04.595498    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f" podStartSLOduration=1.595472232 podStartE2EDuration="1.595472232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:47:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:47:04.594568649 +0000 UTC m=+1768.267434088" watchObservedRunningTime="2026-07-23 13:47:04.595472232 +0000 UTC m=+1768.268337670"
Jul 23 13:47:05.582419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:05.582386    2581 generic.go:356] "Generic (PLEG): container finished" podID="a4f45241-f52e-4823-b209-3dea5346b8c2" containerID="e62f83993b4cc88313d11bff2df53537d513169705eef8becde08e33ea6991c3" exitCode=0
Jul 23 13:47:05.582805 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:05.582445    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f" event={"ID":"a4f45241-f52e-4823-b209-3dea5346b8c2","Type":"ContainerDied","Data":"e62f83993b4cc88313d11bff2df53537d513169705eef8becde08e33ea6991c3"}
Jul 23 13:47:06.712952 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:06.712927    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:06.842326 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:06.842267    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f45241-f52e-4823-b209-3dea5346b8c2-maas-api-service-ca\") pod \"a4f45241-f52e-4823-b209-3dea5346b8c2\" (UID: \"a4f45241-f52e-4823-b209-3dea5346b8c2\") "
Jul 23 13:47:06.842609 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:06.842589    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4f45241-f52e-4823-b209-3dea5346b8c2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a4f45241-f52e-4823-b209-3dea5346b8c2" (UID: "a4f45241-f52e-4823-b209-3dea5346b8c2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:06.943771 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:06.943746    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a4f45241-f52e-4823-b209-3dea5346b8c2-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:47:07.593556 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:07.593529    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"
Jul 23 13:47:07.593719 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:07.593564    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f" event={"ID":"a4f45241-f52e-4823-b209-3dea5346b8c2","Type":"ContainerDied","Data":"70c282d79acfba3367493e90897a8df12f7ebd8d99a8a15718c992d6a2064fca"}
Jul 23 13:47:07.593719 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:07.593630    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70c282d79acfba3367493e90897a8df12f7ebd8d99a8a15718c992d6a2064fca"
Jul 23 13:47:14.185904 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.185863    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"]
Jul 23 13:47:14.186366 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.186074    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh" podUID="56279a52-657c-4d5f-a0b0-f2f976b294a9" containerName="maas-api" containerID="cri-o://211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a" gracePeriod=30
Jul 23 13:47:14.430686 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.430662    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:47:14.514865 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.514783    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vttm\" (UniqueName: \"kubernetes.io/projected/56279a52-657c-4d5f-a0b0-f2f976b294a9-kube-api-access-4vttm\") pod \"56279a52-657c-4d5f-a0b0-f2f976b294a9\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") "
Jul 23 13:47:14.514865 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.514816    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56279a52-657c-4d5f-a0b0-f2f976b294a9-openshift-service-ca\") pod \"56279a52-657c-4d5f-a0b0-f2f976b294a9\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") "
Jul 23 13:47:14.515036 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.514873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls\") pod \"56279a52-657c-4d5f-a0b0-f2f976b294a9\" (UID: \"56279a52-657c-4d5f-a0b0-f2f976b294a9\") "
Jul 23 13:47:14.515272 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.515236    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56279a52-657c-4d5f-a0b0-f2f976b294a9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56279a52-657c-4d5f-a0b0-f2f976b294a9" (UID: "56279a52-657c-4d5f-a0b0-f2f976b294a9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:47:14.517083 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.517062    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56279a52-657c-4d5f-a0b0-f2f976b294a9-kube-api-access-4vttm" (OuterVolumeSpecName: "kube-api-access-4vttm") pod "56279a52-657c-4d5f-a0b0-f2f976b294a9" (UID: "56279a52-657c-4d5f-a0b0-f2f976b294a9"). InnerVolumeSpecName "kube-api-access-4vttm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:47:14.517202 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.517080    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56279a52-657c-4d5f-a0b0-f2f976b294a9" (UID: "56279a52-657c-4d5f-a0b0-f2f976b294a9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:47:14.615792 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.615757    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vttm\" (UniqueName: \"kubernetes.io/projected/56279a52-657c-4d5f-a0b0-f2f976b294a9-kube-api-access-4vttm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:47:14.615792 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.615785    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56279a52-657c-4d5f-a0b0-f2f976b294a9-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:47:14.615792 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.615796    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56279a52-657c-4d5f-a0b0-f2f976b294a9-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:47:14.628116 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.628060    2581 generic.go:356] "Generic (PLEG): container finished" podID="56279a52-657c-4d5f-a0b0-f2f976b294a9" containerID="211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a" exitCode=0
Jul 23 13:47:14.628271 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.628137    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"
Jul 23 13:47:14.628271 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.628126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh" event={"ID":"56279a52-657c-4d5f-a0b0-f2f976b294a9","Type":"ContainerDied","Data":"211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a"}
Jul 23 13:47:14.628376 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.628310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh" event={"ID":"56279a52-657c-4d5f-a0b0-f2f976b294a9","Type":"ContainerDied","Data":"e0204032c0dd5d604395b79219641f2874961569cf99d2a99f81a1d3584e9142"}
Jul 23 13:47:14.628376 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.628348    2581 scope.go:117] "RemoveContainer" containerID="211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a"
Jul 23 13:47:14.637872 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.637855    2581 scope.go:117] "RemoveContainer" containerID="211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a"
Jul 23 13:47:14.638148 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:47:14.638131    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a\": container with ID starting with 211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a not found: ID does not exist" containerID="211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a"
Jul 23 13:47:14.638208 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.638157    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a"} err="failed to get container status \"211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a\": rpc error: code = NotFound desc = could not find container \"211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a\": container with ID starting with 211b1c012efa0e5c8cb2d214f8787997715244ccfa593ab251376184e181115a not found: ID does not exist"
Jul 23 13:47:14.650497 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.650476    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"]
Jul 23 13:47:14.654611 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.654589    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-dceaf465-8454454-pz7vh"]
Jul 23 13:47:14.817694 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:14.817615    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56279a52-657c-4d5f-a0b0-f2f976b294a9" path="/var/lib/kubelet/pods/56279a52-657c-4d5f-a0b0-f2f976b294a9/volumes"
Jul 23 13:47:16.930586 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:16.930549    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:47:18.763487 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:18.763458    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"]
Jul 23 13:47:18.769624 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:18.769600    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-dceaf465-nlk6f"]
Jul 23 13:47:18.817362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:18.817341    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4f45241-f52e-4823-b209-3dea5346b8c2" path="/var/lib/kubelet/pods/a4f45241-f52e-4823-b209-3dea5346b8c2/volumes"
Jul 23 13:47:36.919924 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:36.919887    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:47:36.923479 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:47:36.923454    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:48:53.635428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:48:53.635395    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:49:01.937978 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:01.937904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:49:05.374774 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.374744    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"]
Jul 23 13:49:05.375166 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.375114    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56279a52-657c-4d5f-a0b0-f2f976b294a9" containerName="maas-api"
Jul 23 13:49:05.375166 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.375125    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="56279a52-657c-4d5f-a0b0-f2f976b294a9" containerName="maas-api"
Jul 23 13:49:05.375166 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.375142    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4f45241-f52e-4823-b209-3dea5346b8c2" containerName="revoke-keys"
Jul 23 13:49:05.375166 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.375148    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4f45241-f52e-4823-b209-3dea5346b8c2" containerName="revoke-keys"
Jul 23 13:49:05.375308 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.375221    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="56279a52-657c-4d5f-a0b0-f2f976b294a9" containerName="maas-api"
Jul 23 13:49:05.375308 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.375230    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4f45241-f52e-4823-b209-3dea5346b8c2" containerName="revoke-keys"
Jul 23 13:49:05.378474 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.378458    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.396995 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.396972    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ae29a373-serving-cert\""
Jul 23 13:49:05.397252 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.396969    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:49:05.397394 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.397018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:49:05.397394 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.397025    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:49:05.399511 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.399493    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"]
Jul 23 13:49:05.456299 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.456276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.456429 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.456336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9zcb\" (UniqueName: \"kubernetes.io/projected/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-kube-api-access-h9zcb\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.456429 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.456401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-openshift-service-ca\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.557535 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.557510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-openshift-service-ca\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.557639 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.557566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.557639 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.557600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9zcb\" (UniqueName: \"kubernetes.io/projected/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-kube-api-access-h9zcb\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.557731 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:49:05.557714    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-serving-cert: secret "maas-api-e2e-mt-ae29a373-serving-cert" not found
Jul 23 13:49:05.557813 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:49:05.557794    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls podName:8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0 nodeName:}" failed. No retries permitted until 2026-07-23 13:49:06.057774668 +0000 UTC m=+1889.730640086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls") pod "maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" (UID: "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0") : secret "maas-api-e2e-mt-ae29a373-serving-cert" not found
Jul 23 13:49:05.558242 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.558222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-openshift-service-ca\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:05.569681 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:05.569662    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9zcb\" (UniqueName: \"kubernetes.io/projected/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-kube-api-access-h9zcb\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:06.060838 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:06.060796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:06.063047 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:06.063018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls\") pod \"maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:06.291010 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:06.290983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:06.433676 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:06.433647    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"]
Jul 23 13:49:06.434708 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:49:06.434685    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa58d90_dde3_41fa_b257_cd1cc6d0b0f0.slice/crio-356c69e23dd4991da3c49ef599988bfcacf2ff8ff148592249efa92ba55bf971 WatchSource:0}: Error finding container 356c69e23dd4991da3c49ef599988bfcacf2ff8ff148592249efa92ba55bf971: Status 404 returned error can't find the container with id 356c69e23dd4991da3c49ef599988bfcacf2ff8ff148592249efa92ba55bf971
Jul 23 13:49:07.200297 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:07.200256    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" event={"ID":"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0","Type":"ContainerStarted","Data":"ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806"}
Jul 23 13:49:07.200475 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:07.200308    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" event={"ID":"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0","Type":"ContainerStarted","Data":"356c69e23dd4991da3c49ef599988bfcacf2ff8ff148592249efa92ba55bf971"}
Jul 23 13:49:07.200475 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:07.200334    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:07.226869 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:07.226777    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" podStartSLOduration=1.71161472 podStartE2EDuration="2.22676208s" totalImagesPullingTime="515.14736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:07.225120823 +0000 UTC m=+1890.897986267" watchObservedRunningTime="2026-07-23 13:49:07.22676208 +0000 UTC m=+1890.899627520"
Jul 23 13:49:11.009242 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:11.009201    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:49:13.210502 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:13.210475    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:17.204923 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.204889    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"]
Jul 23 13:49:17.208513 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.208496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:17.212079 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.212055    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:49:17.224652 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.224624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"]
Jul 23 13:49:17.348025 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.347988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f08b14-7ee0-415c-8539-171bc2379596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ae29a373-n269r\" (UID: \"c2f08b14-7ee0-415c-8539-171bc2379596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:17.448957 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.448930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f08b14-7ee0-415c-8539-171bc2379596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ae29a373-n269r\" (UID: \"c2f08b14-7ee0-415c-8539-171bc2379596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:17.449508 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.449487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f08b14-7ee0-415c-8539-171bc2379596-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ae29a373-n269r\" (UID: \"c2f08b14-7ee0-415c-8539-171bc2379596\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:17.519110 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.519040    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:17.672964 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:17.672938    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"]
Jul 23 13:49:17.674210 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:49:17.674183    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f08b14_7ee0_415c_8539_171bc2379596.slice/crio-d6fc3da0e53b6b28a8ef6c2858e2eec4b47c2e9b5a346885766f271bbac672d2 WatchSource:0}: Error finding container d6fc3da0e53b6b28a8ef6c2858e2eec4b47c2e9b5a346885766f271bbac672d2: Status 404 returned error can't find the container with id d6fc3da0e53b6b28a8ef6c2858e2eec4b47c2e9b5a346885766f271bbac672d2
Jul 23 13:49:18.256231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:18.256161    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r" event={"ID":"c2f08b14-7ee0-415c-8539-171bc2379596","Type":"ContainerStarted","Data":"ba84d5892d436d375112cad86a73ecfbc6d413a223b985f44185ad5a1c8675c5"}
Jul 23 13:49:18.256231 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:18.256208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r" event={"ID":"c2f08b14-7ee0-415c-8539-171bc2379596","Type":"ContainerStarted","Data":"d6fc3da0e53b6b28a8ef6c2858e2eec4b47c2e9b5a346885766f271bbac672d2"}
Jul 23 13:49:18.274387 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:18.274348    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r" podStartSLOduration=1.274334319 podStartE2EDuration="1.274334319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:49:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:49:18.273726694 +0000 UTC m=+1901.946592133" watchObservedRunningTime="2026-07-23 13:49:18.274334319 +0000 UTC m=+1901.947199759"
Jul 23 13:49:19.262500 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:19.262469    2581 generic.go:356] "Generic (PLEG): container finished" podID="c2f08b14-7ee0-415c-8539-171bc2379596" containerID="ba84d5892d436d375112cad86a73ecfbc6d413a223b985f44185ad5a1c8675c5" exitCode=0
Jul 23 13:49:19.262877 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:19.262570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r" event={"ID":"c2f08b14-7ee0-415c-8539-171bc2379596","Type":"ContainerDied","Data":"ba84d5892d436d375112cad86a73ecfbc6d413a223b985f44185ad5a1c8675c5"}
Jul 23 13:49:20.398399 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:20.398371    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:20.576916 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:20.576844    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f08b14-7ee0-415c-8539-171bc2379596-maas-api-service-ca\") pod \"c2f08b14-7ee0-415c-8539-171bc2379596\" (UID: \"c2f08b14-7ee0-415c-8539-171bc2379596\") "
Jul 23 13:49:20.577179 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:20.577159    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f08b14-7ee0-415c-8539-171bc2379596-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c2f08b14-7ee0-415c-8539-171bc2379596" (UID: "c2f08b14-7ee0-415c-8539-171bc2379596"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:49:20.677798 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:20.677768    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f08b14-7ee0-415c-8539-171bc2379596-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:49:21.279322 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:21.279284    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r" event={"ID":"c2f08b14-7ee0-415c-8539-171bc2379596","Type":"ContainerDied","Data":"d6fc3da0e53b6b28a8ef6c2858e2eec4b47c2e9b5a346885766f271bbac672d2"}
Jul 23 13:49:21.279481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:21.279359    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6fc3da0e53b6b28a8ef6c2858e2eec4b47c2e9b5a346885766f271bbac672d2"
Jul 23 13:49:21.279481 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:21.279301    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"
Jul 23 13:49:27.384246 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.384214    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"]
Jul 23 13:49:27.384820 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.384442    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" podUID="8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" containerName="maas-api" containerID="cri-o://ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806" gracePeriod=30
Jul 23 13:49:27.629489 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.629466    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:27.736656 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.736595    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9zcb\" (UniqueName: \"kubernetes.io/projected/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-kube-api-access-h9zcb\") pod \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") "
Jul 23 13:49:27.736656 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.736632    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-openshift-service-ca\") pod \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") "
Jul 23 13:49:27.736830 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.736681    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls\") pod \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\" (UID: \"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0\") "
Jul 23 13:49:27.737102 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.737054    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" (UID: "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:49:27.738817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.738795    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" (UID: "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:49:27.738817 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.738800    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-kube-api-access-h9zcb" (OuterVolumeSpecName: "kube-api-access-h9zcb") pod "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" (UID: "8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0"). InnerVolumeSpecName "kube-api-access-h9zcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:49:27.837746 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.837721    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9zcb\" (UniqueName: \"kubernetes.io/projected/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-kube-api-access-h9zcb\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:49:27.837746 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.837746    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:49:27.837865 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:27.837760    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:49:28.315224 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.315194    2581 generic.go:356] "Generic (PLEG): container finished" podID="8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" containerID="ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806" exitCode=0
Jul 23 13:49:28.315381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.315235    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"
Jul 23 13:49:28.315381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.315259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" event={"ID":"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0","Type":"ContainerDied","Data":"ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806"}
Jul 23 13:49:28.315381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.315298    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps" event={"ID":"8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0","Type":"ContainerDied","Data":"356c69e23dd4991da3c49ef599988bfcacf2ff8ff148592249efa92ba55bf971"}
Jul 23 13:49:28.315381 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.315320    2581 scope.go:117] "RemoveContainer" containerID="ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806"
Jul 23 13:49:28.331056 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.331029    2581 scope.go:117] "RemoveContainer" containerID="ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806"
Jul 23 13:49:28.331356 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:49:28.331333    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806\": container with ID starting with ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806 not found: ID does not exist" containerID="ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806"
Jul 23 13:49:28.331424 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.331368    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806"} err="failed to get container status \"ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806\": rpc error: code = NotFound desc = could not find container \"ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806\": container with ID starting with ac3dcaaddb873c5726c8a10fde39c8bc563e4bb77d117a0f4cc0ec2dd202d806 not found: ID does not exist"
Jul 23 13:49:28.354750 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.354729    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"]
Jul 23 13:49:28.358852 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.358833    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ae29a373-6bc646c7c7-tpqps"]
Jul 23 13:49:28.817142 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:28.817105    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" path="/var/lib/kubelet/pods/8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0/volumes"
Jul 23 13:49:30.320000 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:30.319969    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:49:32.268201 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:32.268166    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"]
Jul 23 13:49:32.276468 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:32.276442    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ae29a373-n269r"]
Jul 23 13:49:32.817738 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:49:32.817708    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f08b14-7ee0-415c-8539-171bc2379596" path="/var/lib/kubelet/pods/c2f08b14-7ee0-415c-8539-171bc2379596/volumes"
Jul 23 13:50:03.549879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.549845    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"]
Jul 23 13:50:03.550412 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.550237    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" containerName="maas-api"
Jul 23 13:50:03.550412 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.550249    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" containerName="maas-api"
Jul 23 13:50:03.550412 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.550257    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f08b14-7ee0-415c-8539-171bc2379596" containerName="revoke-keys"
Jul 23 13:50:03.550412 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.550262    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f08b14-7ee0-415c-8539-171bc2379596" containerName="revoke-keys"
Jul 23 13:50:03.550412 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.550334    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2f08b14-7ee0-415c-8539-171bc2379596" containerName="revoke-keys"
Jul 23 13:50:03.550412 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.550343    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa58d90-dde3-41fa-b257-cd1cc6d0b0f0" containerName="maas-api"
Jul 23 13:50:03.553568 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.553552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.556967 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.556938    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5f52d341-serving-cert\""
Jul 23 13:50:03.557130 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.557050    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:50:03.558245 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.558230    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:50:03.564215 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.564199    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:50:03.589241 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.589218    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"]
Jul 23 13:50:03.619373 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.619348    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc044723-710f-4d5a-b8c5-f168549997a2-openshift-service-ca\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.619510 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.619381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkx5\" (UniqueName: \"kubernetes.io/projected/bc044723-710f-4d5a-b8c5-f168549997a2-kube-api-access-dlkx5\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.619510 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.619441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc044723-710f-4d5a-b8c5-f168549997a2-maas-api-tls\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.720312 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.720292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc044723-710f-4d5a-b8c5-f168549997a2-maas-api-tls\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.720442 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.720343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc044723-710f-4d5a-b8c5-f168549997a2-openshift-service-ca\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.720442 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.720374    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkx5\" (UniqueName: \"kubernetes.io/projected/bc044723-710f-4d5a-b8c5-f168549997a2-kube-api-access-dlkx5\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.720927 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.720906    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc044723-710f-4d5a-b8c5-f168549997a2-openshift-service-ca\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.722848 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.722824    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc044723-710f-4d5a-b8c5-f168549997a2-maas-api-tls\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.731129 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.731103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkx5\" (UniqueName: \"kubernetes.io/projected/bc044723-710f-4d5a-b8c5-f168549997a2-kube-api-access-dlkx5\") pod \"maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:03.863364 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:03.863314    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:04.009137 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:04.009114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"]
Jul 23 13:50:04.010763 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:50:04.010737    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc044723_710f_4d5a_b8c5_f168549997a2.slice/crio-160b18d14c1e86a98222cdf51aaae6e0f5bd99c4f2af642a7e3bfe17b35565e0 WatchSource:0}: Error finding container 160b18d14c1e86a98222cdf51aaae6e0f5bd99c4f2af642a7e3bfe17b35565e0: Status 404 returned error can't find the container with id 160b18d14c1e86a98222cdf51aaae6e0f5bd99c4f2af642a7e3bfe17b35565e0
Jul 23 13:50:04.012101 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:04.012076    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:50:04.494109 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:04.494058    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j" event={"ID":"bc044723-710f-4d5a-b8c5-f168549997a2","Type":"ContainerStarted","Data":"160b18d14c1e86a98222cdf51aaae6e0f5bd99c4f2af642a7e3bfe17b35565e0"}
Jul 23 13:50:05.500540 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:05.500501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j" event={"ID":"bc044723-710f-4d5a-b8c5-f168549997a2","Type":"ContainerStarted","Data":"3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730"}
Jul 23 13:50:05.500998 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:05.500555    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:05.547373 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:05.547322    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j" podStartSLOduration=1.8909784680000001 podStartE2EDuration="2.547307267s" totalImagesPullingTime="656.328799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:05.545012659 +0000 UTC m=+1949.217878099" watchObservedRunningTime="2026-07-23 13:50:05.547307267 +0000 UTC m=+1949.220172706"
Jul 23 13:50:10.208044 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:10.208006    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:50:11.510476 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:11.510447    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:50:29.114430 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:29.114354    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:50:50.320171 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:50.320131    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:50:57.006632 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.006602    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"]
Jul 23 13:50:57.009724 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.009708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:50:57.012300 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.012278    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:50:57.017469 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.017445    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"]
Jul 23 13:50:57.123931 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.123910    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa368b8-ea9a-462c-ac14-49c44732b204-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5f52d341-hckc7\" (UID: \"1fa368b8-ea9a-462c-ac14-49c44732b204\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:50:57.225105 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.225069    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa368b8-ea9a-462c-ac14-49c44732b204-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5f52d341-hckc7\" (UID: \"1fa368b8-ea9a-462c-ac14-49c44732b204\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:50:57.225643 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.225625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa368b8-ea9a-462c-ac14-49c44732b204-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5f52d341-hckc7\" (UID: \"1fa368b8-ea9a-462c-ac14-49c44732b204\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:50:57.321160 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.321101    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:50:57.460073 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.460045    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"]
Jul 23 13:50:57.461880 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:50:57.461844    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa368b8_ea9a_462c_ac14_49c44732b204.slice/crio-16d848014fa4c3a62d0569a94a478c97a1b515f9f7986e113aaa4f48f6d1ff95 WatchSource:0}: Error finding container 16d848014fa4c3a62d0569a94a478c97a1b515f9f7986e113aaa4f48f6d1ff95: Status 404 returned error can't find the container with id 16d848014fa4c3a62d0569a94a478c97a1b515f9f7986e113aaa4f48f6d1ff95
Jul 23 13:50:57.758444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.758417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7" event={"ID":"1fa368b8-ea9a-462c-ac14-49c44732b204","Type":"ContainerStarted","Data":"d531d8c6ef32e79082e8cb0dfcd7d03b38f37774d6947cbb4527a6bf96e1ca19"}
Jul 23 13:50:57.758547 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.758466    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7" event={"ID":"1fa368b8-ea9a-462c-ac14-49c44732b204","Type":"ContainerStarted","Data":"16d848014fa4c3a62d0569a94a478c97a1b515f9f7986e113aaa4f48f6d1ff95"}
Jul 23 13:50:57.774450 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:57.774384    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7" podStartSLOduration=1.774364599 podStartE2EDuration="1.774364599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:50:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:50:57.773919454 +0000 UTC m=+2001.446784895" watchObservedRunningTime="2026-07-23 13:50:57.774364599 +0000 UTC m=+2001.447230040"
Jul 23 13:50:58.764747 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:58.764715    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fa368b8-ea9a-462c-ac14-49c44732b204" containerID="d531d8c6ef32e79082e8cb0dfcd7d03b38f37774d6947cbb4527a6bf96e1ca19" exitCode=0
Jul 23 13:50:58.765077 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:58.764759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7" event={"ID":"1fa368b8-ea9a-462c-ac14-49c44732b204","Type":"ContainerDied","Data":"d531d8c6ef32e79082e8cb0dfcd7d03b38f37774d6947cbb4527a6bf96e1ca19"}
Jul 23 13:50:59.898745 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:59.898720    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:50:59.946430 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:59.946395    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa368b8-ea9a-462c-ac14-49c44732b204-maas-api-service-ca\") pod \"1fa368b8-ea9a-462c-ac14-49c44732b204\" (UID: \"1fa368b8-ea9a-462c-ac14-49c44732b204\") "
Jul 23 13:50:59.946724 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:50:59.946703    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fa368b8-ea9a-462c-ac14-49c44732b204-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1fa368b8-ea9a-462c-ac14-49c44732b204" (UID: "1fa368b8-ea9a-462c-ac14-49c44732b204"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:51:00.047677 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:00.047602    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fa368b8-ea9a-462c-ac14-49c44732b204-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:51:00.775650 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:00.775616    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"
Jul 23 13:51:00.775823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:00.775646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7" event={"ID":"1fa368b8-ea9a-462c-ac14-49c44732b204","Type":"ContainerDied","Data":"16d848014fa4c3a62d0569a94a478c97a1b515f9f7986e113aaa4f48f6d1ff95"}
Jul 23 13:51:00.775823 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:00.775731    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16d848014fa4c3a62d0569a94a478c97a1b515f9f7986e113aaa4f48f6d1ff95"
Jul 23 13:51:11.631969 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:11.631934    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:51:12.507962 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.507930    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"]
Jul 23 13:51:12.508181 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.508145    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j" podUID="bc044723-710f-4d5a-b8c5-f168549997a2" containerName="maas-api" containerID="cri-o://3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730" gracePeriod=30
Jul 23 13:51:12.761346 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.761288    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:51:12.836198 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.836170    2581 generic.go:356] "Generic (PLEG): container finished" podID="bc044723-710f-4d5a-b8c5-f168549997a2" containerID="3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730" exitCode=0
Jul 23 13:51:12.836339 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.836208    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j" event={"ID":"bc044723-710f-4d5a-b8c5-f168549997a2","Type":"ContainerDied","Data":"3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730"}
Jul 23 13:51:12.836339 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.836212    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"
Jul 23 13:51:12.836339 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.836244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j" event={"ID":"bc044723-710f-4d5a-b8c5-f168549997a2","Type":"ContainerDied","Data":"160b18d14c1e86a98222cdf51aaae6e0f5bd99c4f2af642a7e3bfe17b35565e0"}
Jul 23 13:51:12.836339 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.836264    2581 scope.go:117] "RemoveContainer" containerID="3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730"
Jul 23 13:51:12.844830 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.844811    2581 scope.go:117] "RemoveContainer" containerID="3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730"
Jul 23 13:51:12.845069 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:51:12.845050    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730\": container with ID starting with 3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730 not found: ID does not exist" containerID="3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730"
Jul 23 13:51:12.845142 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.845079    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730"} err="failed to get container status \"3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730\": rpc error: code = NotFound desc = could not find container \"3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730\": container with ID starting with 3929b4e2e64839e58cfe3688b6aed7774ecd084b2882cf33efad518f38d4a730 not found: ID does not exist"
Jul 23 13:51:12.849390 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.849370    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlkx5\" (UniqueName: \"kubernetes.io/projected/bc044723-710f-4d5a-b8c5-f168549997a2-kube-api-access-dlkx5\") pod \"bc044723-710f-4d5a-b8c5-f168549997a2\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") "
Jul 23 13:51:12.849482 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.849463    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc044723-710f-4d5a-b8c5-f168549997a2-maas-api-tls\") pod \"bc044723-710f-4d5a-b8c5-f168549997a2\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") "
Jul 23 13:51:12.849550 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.849493    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc044723-710f-4d5a-b8c5-f168549997a2-openshift-service-ca\") pod \"bc044723-710f-4d5a-b8c5-f168549997a2\" (UID: \"bc044723-710f-4d5a-b8c5-f168549997a2\") "
Jul 23 13:51:12.849816 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.849796    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc044723-710f-4d5a-b8c5-f168549997a2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc044723-710f-4d5a-b8c5-f168549997a2" (UID: "bc044723-710f-4d5a-b8c5-f168549997a2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:51:12.851341 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.851322    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc044723-710f-4d5a-b8c5-f168549997a2-kube-api-access-dlkx5" (OuterVolumeSpecName: "kube-api-access-dlkx5") pod "bc044723-710f-4d5a-b8c5-f168549997a2" (UID: "bc044723-710f-4d5a-b8c5-f168549997a2"). InnerVolumeSpecName "kube-api-access-dlkx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:51:12.851545 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.851523    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc044723-710f-4d5a-b8c5-f168549997a2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc044723-710f-4d5a-b8c5-f168549997a2" (UID: "bc044723-710f-4d5a-b8c5-f168549997a2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:51:12.950503 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.950479    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc044723-710f-4d5a-b8c5-f168549997a2-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:51:12.950503 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.950500    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc044723-710f-4d5a-b8c5-f168549997a2-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:51:12.950631 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:12.950511    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlkx5\" (UniqueName: \"kubernetes.io/projected/bc044723-710f-4d5a-b8c5-f168549997a2-kube-api-access-dlkx5\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:51:13.158605 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:13.158581    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"]
Jul 23 13:51:13.162576 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:13.162556    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f52d341-5fdbdc9998-5n48j"]
Jul 23 13:51:14.817549 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:14.817519    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc044723-710f-4d5a-b8c5-f168549997a2" path="/var/lib/kubelet/pods/bc044723-710f-4d5a-b8c5-f168549997a2/volumes"
Jul 23 13:51:17.116758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:17.116728    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"]
Jul 23 13:51:17.119304 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:17.119275    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5f52d341-hckc7"]
Jul 23 13:51:18.817585 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:18.817553    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fa368b8-ea9a-462c-ac14-49c44732b204" path="/var/lib/kubelet/pods/1fa368b8-ea9a-462c-ac14-49c44732b204/volumes"
Jul 23 13:51:20.430715 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:20.430678    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:51:37.019157 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:37.019122    2581 scope.go:117] "RemoveContainer" containerID="911a9c8f29427ee508bed56085aee096a680b2b87929c4a1eede0e1383344984"
Jul 23 13:51:37.027242 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:51:37.027210    2581 scope.go:117] "RemoveContainer" containerID="1e3cb1854e90927c9fb26c1528e4aa875a50f02c40653d2466437cfc897c833d"
Jul 23 13:52:18.919952 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:52:18.919921    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:52:27.911691 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:52:27.911654    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:52:36.952807 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:52:36.952781    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:52:36.961884 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:52:36.961862    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:52:37.052699 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:52:37.052673    2581 scope.go:117] "RemoveContainer" containerID="dedce98d4ea10f53d8d1321d9b2a0b240a73e119e85ad25761745e67dca6e3dc"
Jul 23 13:53:08.352336 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352306    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"]
Jul 23 13:53:08.352761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352664    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc044723-710f-4d5a-b8c5-f168549997a2" containerName="maas-api"
Jul 23 13:53:08.352761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352675    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc044723-710f-4d5a-b8c5-f168549997a2" containerName="maas-api"
Jul 23 13:53:08.352761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352698    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fa368b8-ea9a-462c-ac14-49c44732b204" containerName="revoke-keys"
Jul 23 13:53:08.352761 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352704    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fa368b8-ea9a-462c-ac14-49c44732b204" containerName="revoke-keys"
Jul 23 13:53:08.352892 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352764    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fa368b8-ea9a-462c-ac14-49c44732b204" containerName="revoke-keys"
Jul 23 13:53:08.352892 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.352771    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc044723-710f-4d5a-b8c5-f168549997a2" containerName="maas-api"
Jul 23 13:53:08.355581 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.355566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.358911 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.358887    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:53:08.359041 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.358999    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-918c39-serving-cert\""
Jul 23 13:53:08.359145 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.359040    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:53:08.360196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.360178    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:53:08.365689 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.365666    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"]
Jul 23 13:53:08.474778 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.474753    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.474878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.474813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933006e7-46b3-493c-b09a-492f4f2cbf9f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.474878 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.474836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x879r\" (UniqueName: \"kubernetes.io/projected/933006e7-46b3-493c-b09a-492f4f2cbf9f-kube-api-access-x879r\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.575334 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.575310    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933006e7-46b3-493c-b09a-492f4f2cbf9f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.575440 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.575340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x879r\" (UniqueName: \"kubernetes.io/projected/933006e7-46b3-493c-b09a-492f4f2cbf9f-kube-api-access-x879r\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.575440 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.575388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.575532 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:53:08.575512    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-serving-cert: secret "maas-api-e2e-inf-a-918c39-serving-cert" not found
Jul 23 13:53:08.575627 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:53:08.575616    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls podName:933006e7-46b3-493c-b09a-492f4f2cbf9f nodeName:}" failed. No retries permitted until 2026-07-23 13:53:09.075588098 +0000 UTC m=+2132.748453540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls") pod "maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" (UID: "933006e7-46b3-493c-b09a-492f4f2cbf9f") : secret "maas-api-e2e-inf-a-918c39-serving-cert" not found
Jul 23 13:53:08.575998 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.575980    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933006e7-46b3-493c-b09a-492f4f2cbf9f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:08.584318 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:08.584302    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x879r\" (UniqueName: \"kubernetes.io/projected/933006e7-46b3-493c-b09a-492f4f2cbf9f-kube-api-access-x879r\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:09.079365 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:09.079336    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:09.081875 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:09.081854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:09.265949 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:09.265924    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:09.400064 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:09.400039    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"]
Jul 23 13:53:09.402143 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:53:09.402118    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933006e7_46b3_493c_b09a_492f4f2cbf9f.slice/crio-9ae124c12f0945e1521ced57106897888980209cec1fb82808e17e0a2f32b135 WatchSource:0}: Error finding container 9ae124c12f0945e1521ced57106897888980209cec1fb82808e17e0a2f32b135: Status 404 returned error can't find the container with id 9ae124c12f0945e1521ced57106897888980209cec1fb82808e17e0a2f32b135
Jul 23 13:53:09.413392 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:09.413368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" event={"ID":"933006e7-46b3-493c-b09a-492f4f2cbf9f","Type":"ContainerStarted","Data":"9ae124c12f0945e1521ced57106897888980209cec1fb82808e17e0a2f32b135"}
Jul 23 13:53:10.425760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:10.425728    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" event={"ID":"933006e7-46b3-493c-b09a-492f4f2cbf9f","Type":"ContainerStarted","Data":"2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25"}
Jul 23 13:53:10.426131 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:10.425868    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:12.721765 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:12.721716    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" podStartSLOduration=4.334238654 podStartE2EDuration="4.721702299s" totalImagesPullingTime="387.463645ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:53:10.459284253 +0000 UTC m=+2134.132149704" watchObservedRunningTime="2026-07-23 13:53:12.721702299 +0000 UTC m=+2136.394567739"
Jul 23 13:53:12.722169 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:12.721936    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:53:16.370833 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.370805    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"]
Jul 23 13:53:16.373429 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.373408    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.376537 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.376513    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8ecfce-serving-cert\""
Jul 23 13:53:16.385953 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.385931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"]
Jul 23 13:53:16.433802 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.433781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.433906 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.433817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.433953 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.433906    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl454\" (UniqueName: \"kubernetes.io/projected/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-kube-api-access-bl454\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.436633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.436616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:53:16.534389 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.534354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl454\" (UniqueName: \"kubernetes.io/projected/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-kube-api-access-bl454\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.534523 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.534437    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.534523 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.534492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.535111 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.535067    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.536800 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.536778    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-maas-api-tls\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.545948 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.545924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl454\" (UniqueName: \"kubernetes.io/projected/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-kube-api-access-bl454\") pod \"maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.684304 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.684250    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:16.823770 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:16.823739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"]
Jul 23 13:53:16.823963 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:53:16.823944    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd0a2c8_fd36_47a7_b3a4_256e8abe57e9.slice/crio-98a75a3845638a5b8cdb46f90bc932c108857811deeefe43678c68ff95c11449 WatchSource:0}: Error finding container 98a75a3845638a5b8cdb46f90bc932c108857811deeefe43678c68ff95c11449: Status 404 returned error can't find the container with id 98a75a3845638a5b8cdb46f90bc932c108857811deeefe43678c68ff95c11449
Jul 23 13:53:17.461448 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:17.461410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4" event={"ID":"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9","Type":"ContainerStarted","Data":"3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85"}
Jul 23 13:53:17.461790 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:17.461471    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4" event={"ID":"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9","Type":"ContainerStarted","Data":"98a75a3845638a5b8cdb46f90bc932c108857811deeefe43678c68ff95c11449"}
Jul 23 13:53:17.461790 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:17.461507    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:17.490883 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:17.490787    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4" podStartSLOduration=1.087669924 podStartE2EDuration="1.490773248s" totalImagesPullingTime="403.103324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:53:17.489725465 +0000 UTC m=+2141.162590904" watchObservedRunningTime="2026-07-23 13:53:17.490773248 +0000 UTC m=+2141.163638687"
Jul 23 13:53:23.470999 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:23.470964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:53:23.721822 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:23.721747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:53:34.522447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:34.522416    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:53:37.072375 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:53:37.072344    2581 scope.go:117] "RemoveContainer" containerID="e62f83993b4cc88313d11bff2df53537d513169705eef8becde08e33ea6991c3"
Jul 23 13:54:28.019639 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:54:28.019605    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:54:41.414443 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:54:41.414410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:55:07.412830 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.412754    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"]
Jul 23 13:55:07.416428 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.416407    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:07.419130 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.419108    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:55:07.423303 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.423265    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"]
Jul 23 13:55:07.486766 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.486729    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8754c13b-3073-4e4c-8999-ccde56bfcec9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj\" (UID: \"8754c13b-3073-4e4c-8999-ccde56bfcec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:07.587130 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.587084    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8754c13b-3073-4e4c-8999-ccde56bfcec9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj\" (UID: \"8754c13b-3073-4e4c-8999-ccde56bfcec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:07.587700 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.587677    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8754c13b-3073-4e4c-8999-ccde56bfcec9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj\" (UID: \"8754c13b-3073-4e4c-8999-ccde56bfcec9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:07.729131 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.729045    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:07.861784 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.861759    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"]
Jul 23 13:55:07.864037 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:55:07.864009    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8754c13b_3073_4e4c_8999_ccde56bfcec9.slice/crio-bb962e44fe64847445629e04e46d894252c6b759d510dfd136acd5262c8afdff WatchSource:0}: Error finding container bb962e44fe64847445629e04e46d894252c6b759d510dfd136acd5262c8afdff: Status 404 returned error can't find the container with id bb962e44fe64847445629e04e46d894252c6b759d510dfd136acd5262c8afdff
Jul 23 13:55:07.994703 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:07.994645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj" event={"ID":"8754c13b-3073-4e4c-8999-ccde56bfcec9","Type":"ContainerStarted","Data":"bb962e44fe64847445629e04e46d894252c6b759d510dfd136acd5262c8afdff"}
Jul 23 13:55:09.000009 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:08.999976    2581 generic.go:356] "Generic (PLEG): container finished" podID="8754c13b-3073-4e4c-8999-ccde56bfcec9" containerID="763a4fc3329a7fa19ce97d42baa53c85083d239b617443ac0daa5a7bd2cccecb" exitCode=0
Jul 23 13:55:09.000328 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:09.000043    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj" event={"ID":"8754c13b-3073-4e4c-8999-ccde56bfcec9","Type":"ContainerDied","Data":"763a4fc3329a7fa19ce97d42baa53c85083d239b617443ac0daa5a7bd2cccecb"}
Jul 23 13:55:10.134994 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:10.134969    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:10.205388 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:10.205363    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8754c13b-3073-4e4c-8999-ccde56bfcec9-maas-api-service-ca\") pod \"8754c13b-3073-4e4c-8999-ccde56bfcec9\" (UID: \"8754c13b-3073-4e4c-8999-ccde56bfcec9\") "
Jul 23 13:55:10.205694 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:10.205674    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8754c13b-3073-4e4c-8999-ccde56bfcec9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8754c13b-3073-4e4c-8999-ccde56bfcec9" (UID: "8754c13b-3073-4e4c-8999-ccde56bfcec9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:55:10.306540 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:10.306487    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8754c13b-3073-4e4c-8999-ccde56bfcec9-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:11.010208 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:11.010181    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"
Jul 23 13:55:11.010337 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:11.010185    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj" event={"ID":"8754c13b-3073-4e4c-8999-ccde56bfcec9","Type":"ContainerDied","Data":"bb962e44fe64847445629e04e46d894252c6b759d510dfd136acd5262c8afdff"}
Jul 23 13:55:11.010337 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:11.010290    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb962e44fe64847445629e04e46d894252c6b759d510dfd136acd5262c8afdff"
Jul 23 13:55:11.108934 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:11.108873    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:55:18.001170 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.001136    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"]
Jul 23 13:55:18.001531 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.001323    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" podUID="933006e7-46b3-493c-b09a-492f4f2cbf9f" containerName="maas-api" containerID="cri-o://2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25" gracePeriod=30
Jul 23 13:55:18.247802 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.247779    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:55:18.371252 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.371223    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933006e7-46b3-493c-b09a-492f4f2cbf9f-openshift-service-ca\") pod \"933006e7-46b3-493c-b09a-492f4f2cbf9f\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") "
Jul 23 13:55:18.371419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.371266    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls\") pod \"933006e7-46b3-493c-b09a-492f4f2cbf9f\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") "
Jul 23 13:55:18.371419 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.371299    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x879r\" (UniqueName: \"kubernetes.io/projected/933006e7-46b3-493c-b09a-492f4f2cbf9f-kube-api-access-x879r\") pod \"933006e7-46b3-493c-b09a-492f4f2cbf9f\" (UID: \"933006e7-46b3-493c-b09a-492f4f2cbf9f\") "
Jul 23 13:55:18.371638 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.371614    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933006e7-46b3-493c-b09a-492f4f2cbf9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "933006e7-46b3-493c-b09a-492f4f2cbf9f" (UID: "933006e7-46b3-493c-b09a-492f4f2cbf9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:55:18.373480 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.373458    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "933006e7-46b3-493c-b09a-492f4f2cbf9f" (UID: "933006e7-46b3-493c-b09a-492f4f2cbf9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:55:18.373555 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.373503    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933006e7-46b3-493c-b09a-492f4f2cbf9f-kube-api-access-x879r" (OuterVolumeSpecName: "kube-api-access-x879r") pod "933006e7-46b3-493c-b09a-492f4f2cbf9f" (UID: "933006e7-46b3-493c-b09a-492f4f2cbf9f"). InnerVolumeSpecName "kube-api-access-x879r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:55:18.472473 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.472447    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/933006e7-46b3-493c-b09a-492f4f2cbf9f-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:18.472588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.472472    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/933006e7-46b3-493c-b09a-492f4f2cbf9f-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:18.472588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:18.472492    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x879r\" (UniqueName: \"kubernetes.io/projected/933006e7-46b3-493c-b09a-492f4f2cbf9f-kube-api-access-x879r\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:19.050820 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.050784    2581 generic.go:356] "Generic (PLEG): container finished" podID="933006e7-46b3-493c-b09a-492f4f2cbf9f" containerID="2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25" exitCode=0
Jul 23 13:55:19.051196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.050829    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" event={"ID":"933006e7-46b3-493c-b09a-492f4f2cbf9f","Type":"ContainerDied","Data":"2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25"}
Jul 23 13:55:19.051196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.050903    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66" event={"ID":"933006e7-46b3-493c-b09a-492f4f2cbf9f","Type":"ContainerDied","Data":"9ae124c12f0945e1521ced57106897888980209cec1fb82808e17e0a2f32b135"}
Jul 23 13:55:19.051196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.050842    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"
Jul 23 13:55:19.051196 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.050926    2581 scope.go:117] "RemoveContainer" containerID="2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25"
Jul 23 13:55:19.059376 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.059360    2581 scope.go:117] "RemoveContainer" containerID="2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25"
Jul 23 13:55:19.059642 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:55:19.059620    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25\": container with ID starting with 2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25 not found: ID does not exist" containerID="2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25"
Jul 23 13:55:19.059738 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.059646    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25"} err="failed to get container status \"2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25\": rpc error: code = NotFound desc = could not find container \"2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25\": container with ID starting with 2aa42cda2d23855ff92d2cf4df495adfb3238b9d62f04bd09a529db052b73a25 not found: ID does not exist"
Jul 23 13:55:19.069408 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.069390    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"]
Jul 23 13:55:19.073250 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:19.073232    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-918c39-5c8bc56d79-sxz66"]
Jul 23 13:55:20.817707 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:20.817677    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933006e7-46b3-493c-b09a-492f4f2cbf9f" path="/var/lib/kubelet/pods/933006e7-46b3-493c-b09a-492f4f2cbf9f/volumes"
Jul 23 13:55:22.504036 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:22.504009    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"]
Jul 23 13:55:22.507410 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:22.507388    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-918c39-dcdqj"]
Jul 23 13:55:22.817984 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:22.817911    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8754c13b-3073-4e4c-8999-ccde56bfcec9" path="/var/lib/kubelet/pods/8754c13b-3073-4e4c-8999-ccde56bfcec9/volumes"
Jul 23 13:55:26.422760 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:26.422726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:55:29.648486 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648453    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"]
Jul 23 13:55:29.648864 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648823    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933006e7-46b3-493c-b09a-492f4f2cbf9f" containerName="maas-api"
Jul 23 13:55:29.648864 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648833    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="933006e7-46b3-493c-b09a-492f4f2cbf9f" containerName="maas-api"
Jul 23 13:55:29.648864 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648862    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8754c13b-3073-4e4c-8999-ccde56bfcec9" containerName="revoke-keys"
Jul 23 13:55:29.648974 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648868    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8754c13b-3073-4e4c-8999-ccde56bfcec9" containerName="revoke-keys"
Jul 23 13:55:29.648974 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648922    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8754c13b-3073-4e4c-8999-ccde56bfcec9" containerName="revoke-keys"
Jul 23 13:55:29.648974 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.648930    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="933006e7-46b3-493c-b09a-492f4f2cbf9f" containerName="maas-api"
Jul 23 13:55:29.653236 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.653220    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:29.656195 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.656169    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:55:29.660615 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.660560    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"]
Jul 23 13:55:29.764232 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.764201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/998e5e18-39d3-4ce9-abe1-170d0ba8ad00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k\" (UID: \"998e5e18-39d3-4ce9-abe1-170d0ba8ad00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:29.865055 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.865027    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/998e5e18-39d3-4ce9-abe1-170d0ba8ad00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k\" (UID: \"998e5e18-39d3-4ce9-abe1-170d0ba8ad00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:29.865588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.865571    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/998e5e18-39d3-4ce9-abe1-170d0ba8ad00-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k\" (UID: \"998e5e18-39d3-4ce9-abe1-170d0ba8ad00\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:29.965264 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:29.965202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:30.096647 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:30.096625    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"]
Jul 23 13:55:30.098432 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:55:30.098405    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998e5e18_39d3_4ce9_abe1_170d0ba8ad00.slice/crio-d94210059e6cc51be570e817aac3bb26423920515cc7862dd7bb24d79de18773 WatchSource:0}: Error finding container d94210059e6cc51be570e817aac3bb26423920515cc7862dd7bb24d79de18773: Status 404 returned error can't find the container with id d94210059e6cc51be570e817aac3bb26423920515cc7862dd7bb24d79de18773
Jul 23 13:55:30.106082 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:30.106051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k" event={"ID":"998e5e18-39d3-4ce9-abe1-170d0ba8ad00","Type":"ContainerStarted","Data":"d94210059e6cc51be570e817aac3bb26423920515cc7862dd7bb24d79de18773"}
Jul 23 13:55:31.112777 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:31.112691    2581 generic.go:356] "Generic (PLEG): container finished" podID="998e5e18-39d3-4ce9-abe1-170d0ba8ad00" containerID="d4f39d5aa62363ce046752dcb929481100496c2ee641ecd0018860d2d8a70220" exitCode=0
Jul 23 13:55:31.113126 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:31.112773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k" event={"ID":"998e5e18-39d3-4ce9-abe1-170d0ba8ad00","Type":"ContainerDied","Data":"d4f39d5aa62363ce046752dcb929481100496c2ee641ecd0018860d2d8a70220"}
Jul 23 13:55:32.247708 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:32.247682    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:32.281351 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:32.281326    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/998e5e18-39d3-4ce9-abe1-170d0ba8ad00-maas-api-service-ca\") pod \"998e5e18-39d3-4ce9-abe1-170d0ba8ad00\" (UID: \"998e5e18-39d3-4ce9-abe1-170d0ba8ad00\") "
Jul 23 13:55:32.281629 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:32.281610    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/998e5e18-39d3-4ce9-abe1-170d0ba8ad00-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "998e5e18-39d3-4ce9-abe1-170d0ba8ad00" (UID: "998e5e18-39d3-4ce9-abe1-170d0ba8ad00"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:55:32.382685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:32.382659    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/998e5e18-39d3-4ce9-abe1-170d0ba8ad00-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:33.123236 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:33.123204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k" event={"ID":"998e5e18-39d3-4ce9-abe1-170d0ba8ad00","Type":"ContainerDied","Data":"d94210059e6cc51be570e817aac3bb26423920515cc7862dd7bb24d79de18773"}
Jul 23 13:55:33.123375 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:33.123253    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d94210059e6cc51be570e817aac3bb26423920515cc7862dd7bb24d79de18773"
Jul 23 13:55:33.123375 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:33.123216    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"
Jul 23 13:55:37.101068 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:37.101042    2581 scope.go:117] "RemoveContainer" containerID="ba84d5892d436d375112cad86a73ecfbc6d413a223b985f44185ad5a1c8675c5"
Jul 23 13:55:40.299781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.299747    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"]
Jul 23 13:55:40.300286 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.299937    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4" podUID="dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" containerName="maas-api" containerID="cri-o://3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85" gracePeriod=30
Jul 23 13:55:40.548951 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.548929    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:55:40.637221 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.637182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-maas-api-tls\") pod \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") "
Jul 23 13:55:40.637385 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.637233    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-openshift-service-ca\") pod \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") "
Jul 23 13:55:40.637385 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.637267    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bl454\" (UniqueName: \"kubernetes.io/projected/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-kube-api-access-bl454\") pod \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\" (UID: \"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9\") "
Jul 23 13:55:40.637588 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.637565    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" (UID: "dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:55:40.639347 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.639312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" (UID: "dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:55:40.639450 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.639428    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-kube-api-access-bl454" (OuterVolumeSpecName: "kube-api-access-bl454") pod "dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" (UID: "dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9"). InnerVolumeSpecName "kube-api-access-bl454". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:55:40.737929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.737902    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:40.737929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.737927    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:40.738142 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:40.737941    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bl454\" (UniqueName: \"kubernetes.io/projected/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9-kube-api-access-bl454\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:55:41.163268 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.163232    2581 generic.go:356] "Generic (PLEG): container finished" podID="dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" containerID="3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85" exitCode=0
Jul 23 13:55:41.163447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.163280    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"
Jul 23 13:55:41.163447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.163323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4" event={"ID":"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9","Type":"ContainerDied","Data":"3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85"}
Jul 23 13:55:41.163447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.163377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4" event={"ID":"dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9","Type":"ContainerDied","Data":"98a75a3845638a5b8cdb46f90bc932c108857811deeefe43678c68ff95c11449"}
Jul 23 13:55:41.163447 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.163398    2581 scope.go:117] "RemoveContainer" containerID="3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85"
Jul 23 13:55:41.172495 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.172473    2581 scope.go:117] "RemoveContainer" containerID="3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85"
Jul 23 13:55:41.172772 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:55:41.172738    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85\": container with ID starting with 3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85 not found: ID does not exist" containerID="3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85"
Jul 23 13:55:41.172772 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.172767    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85"} err="failed to get container status \"3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85\": rpc error: code = NotFound desc = could not find container \"3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85\": container with ID starting with 3b07458cbb18dd96ef8aafdf4ce327796a41a443235defcfdefb01e611483b85 not found: ID does not exist"
Jul 23 13:55:41.179832 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.179806    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"]
Jul 23 13:55:41.183420 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:41.183398    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8ecfce-6bf59dfb4f-sqnq4"]
Jul 23 13:55:42.818083 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:42.818047    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" path="/var/lib/kubelet/pods/dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9/volumes"
Jul 23 13:55:42.917436 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:42.917396    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:55:44.724443 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:44.724404    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"]
Jul 23 13:55:44.727435 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:44.727408    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8ecfce-wj97k"]
Jul 23 13:55:44.817577 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:44.817544    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="998e5e18-39d3-4ce9-abe1-170d0ba8ad00" path="/var/lib/kubelet/pods/998e5e18-39d3-4ce9-abe1-170d0ba8ad00/volumes"
Jul 23 13:55:55.203781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.203751    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"]
Jul 23 13:55:55.204181 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.204139    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" containerName="maas-api"
Jul 23 13:55:55.204181 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.204150    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" containerName="maas-api"
Jul 23 13:55:55.204181 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.204158    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="998e5e18-39d3-4ce9-abe1-170d0ba8ad00" containerName="revoke-keys"
Jul 23 13:55:55.204181 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.204163    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="998e5e18-39d3-4ce9-abe1-170d0ba8ad00" containerName="revoke-keys"
Jul 23 13:55:55.204334 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.204231    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="998e5e18-39d3-4ce9-abe1-170d0ba8ad00" containerName="revoke-keys"
Jul 23 13:55:55.204334 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.204242    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbd0a2c8-fd36-47a7-b3a4-256e8abe57e9" containerName="maas-api"
Jul 23 13:55:55.208444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.208424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.211862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.211798    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:55:55.211862 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.211822    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-53facf-serving-cert\""
Jul 23 13:55:55.212587 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.212563    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:55:55.212692 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.212613    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:55:55.219698 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.219670    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"]
Jul 23 13:55:55.275316 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.275287    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac44ce91-57b7-4603-96b6-d00d8ab08f84-openshift-service-ca\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.275477 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.275339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac44ce91-57b7-4603-96b6-d00d8ab08f84-maas-api-tls\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.275477 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.275366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9xs7\" (UniqueName: \"kubernetes.io/projected/ac44ce91-57b7-4603-96b6-d00d8ab08f84-kube-api-access-l9xs7\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.376479 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.376456    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac44ce91-57b7-4603-96b6-d00d8ab08f84-openshift-service-ca\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.376629 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.376499    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac44ce91-57b7-4603-96b6-d00d8ab08f84-maas-api-tls\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.376629 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.376529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9xs7\" (UniqueName: \"kubernetes.io/projected/ac44ce91-57b7-4603-96b6-d00d8ab08f84-kube-api-access-l9xs7\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.377142 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.377122    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac44ce91-57b7-4603-96b6-d00d8ab08f84-openshift-service-ca\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.378997 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.378975    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac44ce91-57b7-4603-96b6-d00d8ab08f84-maas-api-tls\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.386730 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.386708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9xs7\" (UniqueName: \"kubernetes.io/projected/ac44ce91-57b7-4603-96b6-d00d8ab08f84-kube-api-access-l9xs7\") pod \"maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.524478 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.524417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:55.658552 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.658527    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"]
Jul 23 13:55:55.660872 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:55:55.660843    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac44ce91_57b7_4603_96b6_d00d8ab08f84.slice/crio-62d85cf476d7fd217ee62b1cf9b2fd2052b3b4e267b54d4ab358f650a554f057 WatchSource:0}: Error finding container 62d85cf476d7fd217ee62b1cf9b2fd2052b3b4e267b54d4ab358f650a554f057: Status 404 returned error can't find the container with id 62d85cf476d7fd217ee62b1cf9b2fd2052b3b4e267b54d4ab358f650a554f057
Jul 23 13:55:55.662122 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:55.662102    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 13:55:56.243552 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:56.243519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs" event={"ID":"ac44ce91-57b7-4603-96b6-d00d8ab08f84","Type":"ContainerStarted","Data":"eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593"}
Jul 23 13:55:56.243855 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:56.243574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs" event={"ID":"ac44ce91-57b7-4603-96b6-d00d8ab08f84","Type":"ContainerStarted","Data":"62d85cf476d7fd217ee62b1cf9b2fd2052b3b4e267b54d4ab358f650a554f057"}
Jul 23 13:55:56.243855 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:56.243637    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:55:56.264108 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:55:56.264043    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs" podStartSLOduration=0.747456339 podStartE2EDuration="1.264028054s" totalImagesPullingTime="516.571715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:55:56.263371633 +0000 UTC m=+2299.936237073" watchObservedRunningTime="2026-07-23 13:55:56.264028054 +0000 UTC m=+2299.936893493"
Jul 23 13:56:00.019175 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:00.019144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:56:02.252824 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:02.252799    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:56:03.286273 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.286240    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"]
Jul 23 13:56:03.290054 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.290033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.293418 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.293392    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-0c8bf4-serving-cert\""
Jul 23 13:56:03.304584 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.304564    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"]
Jul 23 13:56:03.446764 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.446735    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-maas-api-tls\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.446918 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.446805    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4nz\" (UniqueName: \"kubernetes.io/projected/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-kube-api-access-5s4nz\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.446918 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.446844    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-openshift-service-ca\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.547684 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.547606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-maas-api-tls\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.547684 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.547676    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4nz\" (UniqueName: \"kubernetes.io/projected/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-kube-api-access-5s4nz\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.547936 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.547702    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-openshift-service-ca\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.548387 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.548369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-openshift-service-ca\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.550106 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.550072    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-maas-api-tls\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.561321 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.561295    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4nz\" (UniqueName: \"kubernetes.io/projected/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-kube-api-access-5s4nz\") pod \"maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.600863 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.600838    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:03.736000 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:03.735975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"]
Jul 23 13:56:03.737777 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:56:03.737745    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bd88eb_2324_4a9f_9c74_f1c47bb49747.slice/crio-cbc875312c45158add7e6dbfdd5d4e20b2474314bd5fe03d33c6ba0bb4fb8cd5 WatchSource:0}: Error finding container cbc875312c45158add7e6dbfdd5d4e20b2474314bd5fe03d33c6ba0bb4fb8cd5: Status 404 returned error can't find the container with id cbc875312c45158add7e6dbfdd5d4e20b2474314bd5fe03d33c6ba0bb4fb8cd5
Jul 23 13:56:04.291758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:04.291723    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg" event={"ID":"d5bd88eb-2324-4a9f-9c74-f1c47bb49747","Type":"ContainerStarted","Data":"da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b"}
Jul 23 13:56:04.292139 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:04.291785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg" event={"ID":"d5bd88eb-2324-4a9f-9c74-f1c47bb49747","Type":"ContainerStarted","Data":"cbc875312c45158add7e6dbfdd5d4e20b2474314bd5fe03d33c6ba0bb4fb8cd5"}
Jul 23 13:56:04.292139 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:04.291809    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:04.309578 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:04.309538    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg" podStartSLOduration=0.95848969 podStartE2EDuration="1.309520208s" totalImagesPullingTime="351.030518ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:56:04.308794062 +0000 UTC m=+2307.981659502" watchObservedRunningTime="2026-07-23 13:56:04.309520208 +0000 UTC m=+2307.982385647"
Jul 23 13:56:10.302816 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:10.302777    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:10.527387 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:10.527351    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:56:15.906155 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:15.906121    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"]
Jul 23 13:56:15.909613 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:15.909592    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:15.912371 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:15.912351    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:56:15.917127 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:15.917102    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"]
Jul 23 13:56:16.058768 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:16.058721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069a815e-e044-4bcb-8182-7cfce7855fae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-53facf-n7cml\" (UID: \"069a815e-e044-4bcb-8182-7cfce7855fae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:16.159830 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:16.159742    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069a815e-e044-4bcb-8182-7cfce7855fae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-53facf-n7cml\" (UID: \"069a815e-e044-4bcb-8182-7cfce7855fae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:16.160383 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:16.160364    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069a815e-e044-4bcb-8182-7cfce7855fae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-53facf-n7cml\" (UID: \"069a815e-e044-4bcb-8182-7cfce7855fae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:16.224127 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:16.224058    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:16.370649 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:16.370624    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"]
Jul 23 13:56:16.373516 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:56:16.373487    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069a815e_e044_4bcb_8182_7cfce7855fae.slice/crio-0a3301077e4f31012d4ace17ba913b48b3fa072d1cdcfe455a35ef18c9e3d873 WatchSource:0}: Error finding container 0a3301077e4f31012d4ace17ba913b48b3fa072d1cdcfe455a35ef18c9e3d873: Status 404 returned error can't find the container with id 0a3301077e4f31012d4ace17ba913b48b3fa072d1cdcfe455a35ef18c9e3d873
Jul 23 13:56:17.361142 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:17.361107    2581 generic.go:356] "Generic (PLEG): container finished" podID="069a815e-e044-4bcb-8182-7cfce7855fae" containerID="1fee1d3e53f56eb646b40c644ed12aa415b0e67995c89cf5eaaf0c60111b1ca8" exitCode=0
Jul 23 13:56:17.361521 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:17.361188    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml" event={"ID":"069a815e-e044-4bcb-8182-7cfce7855fae","Type":"ContainerDied","Data":"1fee1d3e53f56eb646b40c644ed12aa415b0e67995c89cf5eaaf0c60111b1ca8"}
Jul 23 13:56:17.361521 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:17.361257    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml" event={"ID":"069a815e-e044-4bcb-8182-7cfce7855fae","Type":"ContainerStarted","Data":"0a3301077e4f31012d4ace17ba913b48b3fa072d1cdcfe455a35ef18c9e3d873"}
Jul 23 13:56:18.498681 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:18.498657    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:18.582629 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:18.582604    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069a815e-e044-4bcb-8182-7cfce7855fae-maas-api-service-ca\") pod \"069a815e-e044-4bcb-8182-7cfce7855fae\" (UID: \"069a815e-e044-4bcb-8182-7cfce7855fae\") "
Jul 23 13:56:18.582929 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:18.582909    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/069a815e-e044-4bcb-8182-7cfce7855fae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "069a815e-e044-4bcb-8182-7cfce7855fae" (UID: "069a815e-e044-4bcb-8182-7cfce7855fae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:56:18.683765 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:18.683743    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/069a815e-e044-4bcb-8182-7cfce7855fae-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:19.372354 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:19.372330    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"
Jul 23 13:56:19.372514 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:19.372330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml" event={"ID":"069a815e-e044-4bcb-8182-7cfce7855fae","Type":"ContainerDied","Data":"0a3301077e4f31012d4ace17ba913b48b3fa072d1cdcfe455a35ef18c9e3d873"}
Jul 23 13:56:19.372514 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:19.372450    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a3301077e4f31012d4ace17ba913b48b3fa072d1cdcfe455a35ef18c9e3d873"
Jul 23 13:56:31.072041 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.071826    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"]
Jul 23 13:56:31.073310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.072785    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs" podUID="ac44ce91-57b7-4603-96b6-d00d8ab08f84" containerName="maas-api" containerID="cri-o://eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593" gracePeriod=30
Jul 23 13:56:31.336781 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.336712    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:56:31.382905 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.382858    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9xs7\" (UniqueName: \"kubernetes.io/projected/ac44ce91-57b7-4603-96b6-d00d8ab08f84-kube-api-access-l9xs7\") pod \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") "
Jul 23 13:56:31.383135 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.382982    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac44ce91-57b7-4603-96b6-d00d8ab08f84-openshift-service-ca\") pod \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") "
Jul 23 13:56:31.383135 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.383115    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac44ce91-57b7-4603-96b6-d00d8ab08f84-maas-api-tls\") pod \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\" (UID: \"ac44ce91-57b7-4603-96b6-d00d8ab08f84\") "
Jul 23 13:56:31.383372 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.383342    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac44ce91-57b7-4603-96b6-d00d8ab08f84-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ac44ce91-57b7-4603-96b6-d00d8ab08f84" (UID: "ac44ce91-57b7-4603-96b6-d00d8ab08f84"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:56:31.383477 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.383439    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac44ce91-57b7-4603-96b6-d00d8ab08f84-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:31.385283 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.385258    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac44ce91-57b7-4603-96b6-d00d8ab08f84-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ac44ce91-57b7-4603-96b6-d00d8ab08f84" (UID: "ac44ce91-57b7-4603-96b6-d00d8ab08f84"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:56:31.385380 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.385318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac44ce91-57b7-4603-96b6-d00d8ab08f84-kube-api-access-l9xs7" (OuterVolumeSpecName: "kube-api-access-l9xs7") pod "ac44ce91-57b7-4603-96b6-d00d8ab08f84" (UID: "ac44ce91-57b7-4603-96b6-d00d8ab08f84"). InnerVolumeSpecName "kube-api-access-l9xs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:56:31.434446 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.434410    2581 generic.go:356] "Generic (PLEG): container finished" podID="ac44ce91-57b7-4603-96b6-d00d8ab08f84" containerID="eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593" exitCode=0
Jul 23 13:56:31.434592 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.434457    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"
Jul 23 13:56:31.434592 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.434453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs" event={"ID":"ac44ce91-57b7-4603-96b6-d00d8ab08f84","Type":"ContainerDied","Data":"eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593"}
Jul 23 13:56:31.434720 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.434590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs" event={"ID":"ac44ce91-57b7-4603-96b6-d00d8ab08f84","Type":"ContainerDied","Data":"62d85cf476d7fd217ee62b1cf9b2fd2052b3b4e267b54d4ab358f650a554f057"}
Jul 23 13:56:31.434720 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.434621    2581 scope.go:117] "RemoveContainer" containerID="eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593"
Jul 23 13:56:31.444173 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.444155    2581 scope.go:117] "RemoveContainer" containerID="eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593"
Jul 23 13:56:31.444419 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:56:31.444400    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593\": container with ID starting with eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593 not found: ID does not exist" containerID="eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593"
Jul 23 13:56:31.444492 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.444433    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593"} err="failed to get container status \"eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593\": rpc error: code = NotFound desc = could not find container \"eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593\": container with ID starting with eef656e11a079397e23a5ce5ecee4805c9a6e0d2d79058529b84791d50169593 not found: ID does not exist"
Jul 23 13:56:31.459157 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.459128    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"]
Jul 23 13:56:31.463440 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.463421    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-53facf-76c6d4b897-zbzcs"]
Jul 23 13:56:31.484136 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.484108    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ac44ce91-57b7-4603-96b6-d00d8ab08f84-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:31.484136 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:31.484131    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9xs7\" (UniqueName: \"kubernetes.io/projected/ac44ce91-57b7-4603-96b6-d00d8ab08f84-kube-api-access-l9xs7\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:32.817879 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:32.817841    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac44ce91-57b7-4603-96b6-d00d8ab08f84" path="/var/lib/kubelet/pods/ac44ce91-57b7-4603-96b6-d00d8ab08f84/volumes"
Jul 23 13:56:33.337157 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:33.337124    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:56:35.999170 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:35.999134    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"]
Jul 23 13:56:36.001683 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:36.001658    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-53facf-n7cml"]
Jul 23 13:56:36.817251 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:36.817216    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="069a815e-e044-4bcb-8182-7cfce7855fae" path="/var/lib/kubelet/pods/069a815e-e044-4bcb-8182-7cfce7855fae/volumes"
Jul 23 13:56:43.178909 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.178867    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"]
Jul 23 13:56:43.179508 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.179464    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="069a815e-e044-4bcb-8182-7cfce7855fae" containerName="revoke-keys"
Jul 23 13:56:43.179508 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.179483    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="069a815e-e044-4bcb-8182-7cfce7855fae" containerName="revoke-keys"
Jul 23 13:56:43.179508 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.179510    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac44ce91-57b7-4603-96b6-d00d8ab08f84" containerName="maas-api"
Jul 23 13:56:43.179685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.179518    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac44ce91-57b7-4603-96b6-d00d8ab08f84" containerName="maas-api"
Jul 23 13:56:43.179685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.179623    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="069a815e-e044-4bcb-8182-7cfce7855fae" containerName="revoke-keys"
Jul 23 13:56:43.179685 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.179641    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac44ce91-57b7-4603-96b6-d00d8ab08f84" containerName="maas-api"
Jul 23 13:56:43.182758 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.182737    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:43.185660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.185641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 13:56:43.192610 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.192589    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"]
Jul 23 13:56:43.275324 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.275290    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f3ed7cd-3680-4383-975f-97bbed7267ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7\" (UID: \"0f3ed7cd-3680-4383-975f-97bbed7267ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:43.376173 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.376151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f3ed7cd-3680-4383-975f-97bbed7267ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7\" (UID: \"0f3ed7cd-3680-4383-975f-97bbed7267ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:43.376711 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.376693    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f3ed7cd-3680-4383-975f-97bbed7267ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7\" (UID: \"0f3ed7cd-3680-4383-975f-97bbed7267ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:43.493580 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.493528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:43.632664 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:43.632643    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"]
Jul 23 13:56:43.634856 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:56:43.634829    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f3ed7cd_3680_4383_975f_97bbed7267ae.slice/crio-022544aef88664fbceb9f28fbb227e36e4c82335ce4953fffff64ceecca48487 WatchSource:0}: Error finding container 022544aef88664fbceb9f28fbb227e36e4c82335ce4953fffff64ceecca48487: Status 404 returned error can't find the container with id 022544aef88664fbceb9f28fbb227e36e4c82335ce4953fffff64ceecca48487
Jul 23 13:56:44.502690 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:44.502660    2581 generic.go:356] "Generic (PLEG): container finished" podID="0f3ed7cd-3680-4383-975f-97bbed7267ae" containerID="066be7481792d86dd8e6ae90647d60543569c3f81bb78ea29080a1c11bd11fc6" exitCode=0
Jul 23 13:56:44.502985 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:44.502743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7" event={"ID":"0f3ed7cd-3680-4383-975f-97bbed7267ae","Type":"ContainerDied","Data":"066be7481792d86dd8e6ae90647d60543569c3f81bb78ea29080a1c11bd11fc6"}
Jul 23 13:56:44.502985 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:44.502795    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7" event={"ID":"0f3ed7cd-3680-4383-975f-97bbed7267ae","Type":"ContainerStarted","Data":"022544aef88664fbceb9f28fbb227e36e4c82335ce4953fffff64ceecca48487"}
Jul 23 13:56:45.633129 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:45.633106    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:45.695657 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:45.695636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f3ed7cd-3680-4383-975f-97bbed7267ae-maas-api-service-ca\") pod \"0f3ed7cd-3680-4383-975f-97bbed7267ae\" (UID: \"0f3ed7cd-3680-4383-975f-97bbed7267ae\") "
Jul 23 13:56:45.695925 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:45.695904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f3ed7cd-3680-4383-975f-97bbed7267ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f3ed7cd-3680-4383-975f-97bbed7267ae" (UID: "0f3ed7cd-3680-4383-975f-97bbed7267ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:56:45.797232 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:45.797179    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f3ed7cd-3680-4383-975f-97bbed7267ae-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:46.514036 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:46.514005    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7" event={"ID":"0f3ed7cd-3680-4383-975f-97bbed7267ae","Type":"ContainerDied","Data":"022544aef88664fbceb9f28fbb227e36e4c82335ce4953fffff64ceecca48487"}
Jul 23 13:56:46.514210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:46.514052    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="022544aef88664fbceb9f28fbb227e36e4c82335ce4953fffff64ceecca48487"
Jul 23 13:56:46.514210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:46.514013    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"
Jul 23 13:56:59.097422 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.097387    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"]
Jul 23 13:56:59.097827 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.097588    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg" podUID="d5bd88eb-2324-4a9f-9c74-f1c47bb49747" containerName="maas-api" containerID="cri-o://da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b" gracePeriod=30
Jul 23 13:56:59.345302 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.345280    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:59.508826 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.508798    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-maas-api-tls\") pod \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") "
Jul 23 13:56:59.508979 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.508833    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-openshift-service-ca\") pod \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") "
Jul 23 13:56:59.508979 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.508873    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s4nz\" (UniqueName: \"kubernetes.io/projected/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-kube-api-access-5s4nz\") pod \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\" (UID: \"d5bd88eb-2324-4a9f-9c74-f1c47bb49747\") "
Jul 23 13:56:59.509152 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.509130    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5bd88eb-2324-4a9f-9c74-f1c47bb49747" (UID: "d5bd88eb-2324-4a9f-9c74-f1c47bb49747"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 13:56:59.510895 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.510878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-kube-api-access-5s4nz" (OuterVolumeSpecName: "kube-api-access-5s4nz") pod "d5bd88eb-2324-4a9f-9c74-f1c47bb49747" (UID: "d5bd88eb-2324-4a9f-9c74-f1c47bb49747"). InnerVolumeSpecName "kube-api-access-5s4nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 13:56:59.510996 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.510976    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5bd88eb-2324-4a9f-9c74-f1c47bb49747" (UID: "d5bd88eb-2324-4a9f-9c74-f1c47bb49747"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 13:56:59.586226 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.586203    2581 generic.go:356] "Generic (PLEG): container finished" podID="d5bd88eb-2324-4a9f-9c74-f1c47bb49747" containerID="da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b" exitCode=0
Jul 23 13:56:59.586332 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.586240    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"
Jul 23 13:56:59.586332 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.586289    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg" event={"ID":"d5bd88eb-2324-4a9f-9c74-f1c47bb49747","Type":"ContainerDied","Data":"da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b"}
Jul 23 13:56:59.586444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.586345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg" event={"ID":"d5bd88eb-2324-4a9f-9c74-f1c47bb49747","Type":"ContainerDied","Data":"cbc875312c45158add7e6dbfdd5d4e20b2474314bd5fe03d33c6ba0bb4fb8cd5"}
Jul 23 13:56:59.586444 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.586376    2581 scope.go:117] "RemoveContainer" containerID="da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b"
Jul 23 13:56:59.595633 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.595617    2581 scope.go:117] "RemoveContainer" containerID="da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b"
Jul 23 13:56:59.595891 ip-10-0-141-235 kubenswrapper[2581]: E0723 13:56:59.595874    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b\": container with ID starting with da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b not found: ID does not exist" containerID="da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b"
Jul 23 13:56:59.595939 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.595900    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b"} err="failed to get container status \"da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b\": rpc error: code = NotFound desc = could not find container \"da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b\": container with ID starting with da772a386a39fdd26d42047426e26915b1ed3cff6b26eb770b46333c2ad42f9b not found: ID does not exist"
Jul 23 13:56:59.609002 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.608981    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"]
Jul 23 13:56:59.610281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.610252    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:59.610281 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.610274    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:59.610388 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.610288    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s4nz\" (UniqueName: \"kubernetes.io/projected/d5bd88eb-2324-4a9f-9c74-f1c47bb49747-kube-api-access-5s4nz\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 13:56:59.613027 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:56:59.613004    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-0c8bf4-6f57489f79-bvndg"]
Jul 23 13:57:00.818198 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:00.818171    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5bd88eb-2324-4a9f-9c74-f1c47bb49747" path="/var/lib/kubelet/pods/d5bd88eb-2324-4a9f-9c74-f1c47bb49747/volumes"
Jul 23 13:57:03.265526 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:03.265493    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"]
Jul 23 13:57:03.268834 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:03.268809    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0c8bf4-qptz7"]
Jul 23 13:57:04.817573 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:04.817541    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f3ed7cd-3680-4383-975f-97bbed7267ae" path="/var/lib/kubelet/pods/0f3ed7cd-3680-4383-975f-97bbed7267ae/volumes"
Jul 23 13:57:04.924775 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:04.924744    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:57:14.639581 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.639545    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"]
Jul 23 13:57:14.640210 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.640191    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f3ed7cd-3680-4383-975f-97bbed7267ae" containerName="revoke-keys"
Jul 23 13:57:14.640261 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.640215    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f3ed7cd-3680-4383-975f-97bbed7267ae" containerName="revoke-keys"
Jul 23 13:57:14.640261 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.640231    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5bd88eb-2324-4a9f-9c74-f1c47bb49747" containerName="maas-api"
Jul 23 13:57:14.640261 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.640240    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5bd88eb-2324-4a9f-9c74-f1c47bb49747" containerName="maas-api"
Jul 23 13:57:14.640362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.640329    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5bd88eb-2324-4a9f-9c74-f1c47bb49747" containerName="maas-api"
Jul 23 13:57:14.640362 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.640343    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f3ed7cd-3680-4383-975f-97bbed7267ae" containerName="revoke-keys"
Jul 23 13:57:14.643415 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.643396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.646520 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.646497    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9gmkc\""
Jul 23 13:57:14.646520 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.646517    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0cb132-serving-cert\""
Jul 23 13:57:14.647913 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.647896    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 13:57:14.648003 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.647919    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 13:57:14.652411 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.652377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"]
Jul 23 13:57:14.824310 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.824272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvcr7\" (UniqueName: \"kubernetes.io/projected/4dcced16-0d4f-4132-8f86-d0034aa0cac6-kube-api-access-kvcr7\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.824484 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.824372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dcced16-0d4f-4132-8f86-d0034aa0cac6-maas-api-tls\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.824484 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.824401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcced16-0d4f-4132-8f86-d0034aa0cac6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.925297 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.925205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcr7\" (UniqueName: \"kubernetes.io/projected/4dcced16-0d4f-4132-8f86-d0034aa0cac6-kube-api-access-kvcr7\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.925464 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.925406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dcced16-0d4f-4132-8f86-d0034aa0cac6-maas-api-tls\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.925464 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.925436    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcced16-0d4f-4132-8f86-d0034aa0cac6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.926034 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.926008    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcced16-0d4f-4132-8f86-d0034aa0cac6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.928079 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.928058    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dcced16-0d4f-4132-8f86-d0034aa0cac6-maas-api-tls\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.935360 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.935325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvcr7\" (UniqueName: \"kubernetes.io/projected/4dcced16-0d4f-4132-8f86-d0034aa0cac6-kube-api-access-kvcr7\") pod \"maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:14.954178 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:14.954144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:15.090623 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:15.090599    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"]
Jul 23 13:57:15.092703 ip-10-0-141-235 kubenswrapper[2581]: W0723 13:57:15.092670    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dcced16_0d4f_4132_8f86_d0034aa0cac6.slice/crio-c89439980c927ed24c49a7f0efa0e39d409ea7798d98a79c1abdbb671273a90b WatchSource:0}: Error finding container c89439980c927ed24c49a7f0efa0e39d409ea7798d98a79c1abdbb671273a90b: Status 404 returned error can't find the container with id c89439980c927ed24c49a7f0efa0e39d409ea7798d98a79c1abdbb671273a90b
Jul 23 13:57:15.664276 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:15.664239    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg" event={"ID":"4dcced16-0d4f-4132-8f86-d0034aa0cac6","Type":"ContainerStarted","Data":"9428e9ba557e6e1676a7463827715babb0093517e1538150f7bb716637058225"}
Jul 23 13:57:15.664660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:15.664323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg" event={"ID":"4dcced16-0d4f-4132-8f86-d0034aa0cac6","Type":"ContainerStarted","Data":"c89439980c927ed24c49a7f0efa0e39d409ea7798d98a79c1abdbb671273a90b"}
Jul 23 13:57:15.664660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:15.664360    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:19.213035 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:19.212979    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg" podStartSLOduration=4.8037362550000005 podStartE2EDuration="5.212961323s" totalImagesPullingTime="409.225068ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 13:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 13:57:15.684403592 +0000 UTC m=+2379.357269031" watchObservedRunningTime="2026-07-23 13:57:19.212961323 +0000 UTC m=+2382.885826770"
Jul 23 13:57:19.213841 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:19.213823    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:57:21.675190 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:21.675158    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 13:57:30.235881 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:30.235846    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:57:36.986297 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:36.986266    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:57:36.996126 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:36.996099    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 13:57:37.140660 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:37.140632    2581 scope.go:117] "RemoveContainer" containerID="d531d8c6ef32e79082e8cb0dfcd7d03b38f37774d6947cbb4527a6bf96e1ca19"
Jul 23 13:57:45.613261 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:57:45.613222    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:58:03.621638 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:58:03.621559    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:58:26.709222 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:58:26.709181    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:58:43.720109 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:58:43.720064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:59:00.480164 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:59:00.480129    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:59:20.415971 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:59:20.415939    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:59:34.526933 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:59:34.526891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 13:59:50.322135 ip-10-0-141-235 kubenswrapper[2581]: I0723 13:59:50.322083    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:00:00.138181 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.138149    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"]
Jul 23 14:00:00.142147 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.142122    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"
Jul 23 14:00:00.143065 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.143043    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"]
Jul 23 14:00:00.145706 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.145685    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 14:00:00.146422 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.146406    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"]
Jul 23 14:00:00.146534 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.146517    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"
Jul 23 14:00:00.149892 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.149873    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"
Jul 23 14:00:00.152443 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.152428    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"
Jul 23 14:00:00.159981 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.159959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"
Jul 23 14:00:00.180952 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.180920    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"]
Jul 23 14:00:00.181079 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.181014    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"]
Jul 23 14:00:00.182742 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.182709    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"]
Jul 23 14:00:00.200487 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.200465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"
Jul 23 14:00:00.381567 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.381543    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"]
Jul 23 14:00:00.383444 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:00:00.383418    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b9c242f_8adf_49e4_ab6f_d89602d6b2a0.slice/crio-49c024fb037e8c00e8a683f25da79eb715bedce546c756d32c822281bc64db6d WatchSource:0}: Error finding container 49c024fb037e8c00e8a683f25da79eb715bedce546c756d32c822281bc64db6d: Status 404 returned error can't find the container with id 49c024fb037e8c00e8a683f25da79eb715bedce546c756d32c822281bc64db6d
Jul 23 14:00:00.505348 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.505319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2" event={"ID":"9b9c242f-8adf-49e4-ab6f-d89602d6b2a0","Type":"ContainerStarted","Data":"49c024fb037e8c00e8a683f25da79eb715bedce546c756d32c822281bc64db6d"}
Jul 23 14:00:00.531024 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:00:00.531002    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b4216e_7738_4ba9_b492_9848339ad769.slice/crio-fc44f236e3c0ff6e6677a9e835b4ff13ab8bfc1b71f62aba498372d541b49d7e WatchSource:0}: Error finding container fc44f236e3c0ff6e6677a9e835b4ff13ab8bfc1b71f62aba498372d541b49d7e: Status 404 returned error can't find the container with id fc44f236e3c0ff6e6677a9e835b4ff13ab8bfc1b71f62aba498372d541b49d7e
Jul 23 14:00:00.531126 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.531027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"]
Jul 23 14:00:00.555695 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:00.555675    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"]
Jul 23 14:00:00.566184 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:00:00.566156    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245ae05d_a9b6_428c_ae8d_477b5842da6c.slice/crio-1897723fff59d6b96809bc10a538cc73e60087a93364bf58ac63fa702124c69b WatchSource:0}: Error finding container 1897723fff59d6b96809bc10a538cc73e60087a93364bf58ac63fa702124c69b: Status 404 returned error can't find the container with id 1897723fff59d6b96809bc10a538cc73e60087a93364bf58ac63fa702124c69b
Jul 23 14:00:01.511976 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.511941    2581 generic.go:356] "Generic (PLEG): container finished" podID="9b9c242f-8adf-49e4-ab6f-d89602d6b2a0" containerID="47d6ed190a6e1d6c9501e51cd88cebee647ff9220b5fd9e0c59e1826113e5c7e" exitCode=0
Jul 23 14:00:01.512352 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.512001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2" event={"ID":"9b9c242f-8adf-49e4-ab6f-d89602d6b2a0","Type":"ContainerDied","Data":"47d6ed190a6e1d6c9501e51cd88cebee647ff9220b5fd9e0c59e1826113e5c7e"}
Jul 23 14:00:01.513375 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.513349    2581 generic.go:356] "Generic (PLEG): container finished" podID="245ae05d-a9b6-428c-ae8d-477b5842da6c" containerID="9c99bf320c7ce679835586a6c30713039a8ede72e0365e6abb2d71f39c2098de" exitCode=0
Jul 23 14:00:01.513508 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.513438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt" event={"ID":"245ae05d-a9b6-428c-ae8d-477b5842da6c","Type":"ContainerDied","Data":"9c99bf320c7ce679835586a6c30713039a8ede72e0365e6abb2d71f39c2098de"}
Jul 23 14:00:01.513508 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.513492    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt" event={"ID":"245ae05d-a9b6-428c-ae8d-477b5842da6c","Type":"ContainerStarted","Data":"1897723fff59d6b96809bc10a538cc73e60087a93364bf58ac63fa702124c69b"}
Jul 23 14:00:01.514748 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.514732    2581 generic.go:356] "Generic (PLEG): container finished" podID="38b4216e-7738-4ba9-b492-9848339ad769" containerID="6afd1c84c976466da7e90bcac87e13b002e1965930044005ffd9fe18f103598b" exitCode=0
Jul 23 14:00:01.514831 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.514788    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q" event={"ID":"38b4216e-7738-4ba9-b492-9848339ad769","Type":"ContainerDied","Data":"6afd1c84c976466da7e90bcac87e13b002e1965930044005ffd9fe18f103598b"}
Jul 23 14:00:01.514831 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:01.514815    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q" event={"ID":"38b4216e-7738-4ba9-b492-9848339ad769","Type":"ContainerStarted","Data":"fc44f236e3c0ff6e6677a9e835b4ff13ab8bfc1b71f62aba498372d541b49d7e"}
Jul 23 14:00:02.664784 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:02.664755    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"
Jul 23 14:00:02.708935 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:02.708908    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"
Jul 23 14:00:02.711927 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:02.711907    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"
Jul 23 14:00:03.526105 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.526058    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"
Jul 23 14:00:03.526269 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.526109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2" event={"ID":"9b9c242f-8adf-49e4-ab6f-d89602d6b2a0","Type":"ContainerDied","Data":"49c024fb037e8c00e8a683f25da79eb715bedce546c756d32c822281bc64db6d"}
Jul 23 14:00:03.526269 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.526151    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49c024fb037e8c00e8a683f25da79eb715bedce546c756d32c822281bc64db6d"
Jul 23 14:00:03.527435 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.527417    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"
Jul 23 14:00:03.527580 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.527455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt" event={"ID":"245ae05d-a9b6-428c-ae8d-477b5842da6c","Type":"ContainerDied","Data":"1897723fff59d6b96809bc10a538cc73e60087a93364bf58ac63fa702124c69b"}
Jul 23 14:00:03.527580 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.527492    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1897723fff59d6b96809bc10a538cc73e60087a93364bf58ac63fa702124c69b"
Jul 23 14:00:03.528885 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.528868    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q"
Jul 23 14:00:03.528885 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.528876    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29746920-ntl9q" event={"ID":"38b4216e-7738-4ba9-b492-9848339ad769","Type":"ContainerDied","Data":"fc44f236e3c0ff6e6677a9e835b4ff13ab8bfc1b71f62aba498372d541b49d7e"}
Jul 23 14:00:03.529059 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:03.528908    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc44f236e3c0ff6e6677a9e835b4ff13ab8bfc1b71f62aba498372d541b49d7e"
Jul 23 14:00:06.917326 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:06.917296    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:00:17.445920 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.445887    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"]
Jul 23 14:00:17.446385 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446300    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38b4216e-7738-4ba9-b492-9848339ad769" containerName="cleanup"
Jul 23 14:00:17.446385 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446312    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="38b4216e-7738-4ba9-b492-9848339ad769" containerName="cleanup"
Jul 23 14:00:17.446385 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446320    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245ae05d-a9b6-428c-ae8d-477b5842da6c" containerName="cleanup"
Jul 23 14:00:17.446385 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446325    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="245ae05d-a9b6-428c-ae8d-477b5842da6c" containerName="cleanup"
Jul 23 14:00:17.446385 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446335    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b9c242f-8adf-49e4-ab6f-d89602d6b2a0" containerName="cleanup"
Jul 23 14:00:17.446385 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446341    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b9c242f-8adf-49e4-ab6f-d89602d6b2a0" containerName="cleanup"
Jul 23 14:00:17.446662 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446411    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b9c242f-8adf-49e4-ab6f-d89602d6b2a0" containerName="cleanup"
Jul 23 14:00:17.446662 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446420    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="38b4216e-7738-4ba9-b492-9848339ad769" containerName="cleanup"
Jul 23 14:00:17.446662 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.446426    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="245ae05d-a9b6-428c-ae8d-477b5842da6c" containerName="cleanup"
Jul 23 14:00:17.449348 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.449328    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.452894 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.452872    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0cb132\"/\"openshift-service-ca.crt\""
Jul 23 14:00:17.453019 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.452875    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0cb132\"/\"kube-root-ca.crt\""
Jul 23 14:00:17.454379 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.454363    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0cb132\"/\"default-dockercfg-w55tv\""
Jul 23 14:00:17.454601 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.454586    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0cb132\"/\"sub-test-model-0cb132-kserve-self-signed-certs\""
Jul 23 14:00:17.464140 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.464119    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"]
Jul 23 14:00:17.582676 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.582644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-home\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.582840 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.582683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-model-cache\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.582840 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.582707    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5a6c44-9720-4d26-bb87-adc751e719b0-tls-certs\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.582840 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.582808    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqbmv\" (UniqueName: \"kubernetes.io/projected/fc5a6c44-9720-4d26-bb87-adc751e719b0-kube-api-access-hqbmv\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.582942 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.582878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-tmp-dir\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.582942 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.582899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-dshm\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.683590 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.683556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-model-cache\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.683590 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.683598    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5a6c44-9720-4d26-bb87-adc751e719b0-tls-certs\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.683845 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.683643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqbmv\" (UniqueName: \"kubernetes.io/projected/fc5a6c44-9720-4d26-bb87-adc751e719b0-kube-api-access-hqbmv\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.683845 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.683697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-tmp-dir\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.683845 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.683717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-dshm\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.684051 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.684024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-home\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.684165 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.684045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-model-cache\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.684165 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.684103    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-tmp-dir\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.684408 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.684390    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-home\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.686020 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.686000    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-dshm\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.686355 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.686340    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5a6c44-9720-4d26-bb87-adc751e719b0-tls-certs\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.699153 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.699082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqbmv\" (UniqueName: \"kubernetes.io/projected/fc5a6c44-9720-4d26-bb87-adc751e719b0-kube-api-access-hqbmv\") pod \"sub-test-model-0cb132-kserve-bc796b69-5v8mb\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") " pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.759289 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.759265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:17.900050 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:17.900018    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"]
Jul 23 14:00:17.901676 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:00:17.901653    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc5a6c44_9720_4d26_bb87_adc751e719b0.slice/crio-26ec0faebc3fd1119783c7ee44afb2c61daf1979919eed441dc1a3ef8ea8f344 WatchSource:0}: Error finding container 26ec0faebc3fd1119783c7ee44afb2c61daf1979919eed441dc1a3ef8ea8f344: Status 404 returned error can't find the container with id 26ec0faebc3fd1119783c7ee44afb2c61daf1979919eed441dc1a3ef8ea8f344
Jul 23 14:00:18.607188 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:18.607152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb" event={"ID":"fc5a6c44-9720-4d26-bb87-adc751e719b0","Type":"ContainerStarted","Data":"26ec0faebc3fd1119783c7ee44afb2c61daf1979919eed441dc1a3ef8ea8f344"}
Jul 23 14:00:22.618475 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:22.618443    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:00:22.630177 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:22.630145    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb" event={"ID":"fc5a6c44-9720-4d26-bb87-adc751e719b0","Type":"ContainerStarted","Data":"3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3"}
Jul 23 14:00:22.649732 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:22.649686    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb" podStartSLOduration=1.128062453 podStartE2EDuration="5.649673938s" totalImagesPullingTime="4.521611485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:00:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:00:22.647702976 +0000 UTC m=+2566.320568442" watchObservedRunningTime="2026-07-23 14:00:22.649673938 +0000 UTC m=+2566.322539377"
Jul 23 14:00:27.760153 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:27.760123    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:27.760566 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:27.760182    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:27.772293 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:27.772271    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:28.670917 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:28.670889    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:00:53.728919 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:00:53.728887    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:01:11.718037 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:11.718003    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:01:28.016851 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:28.016817    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:01:34.000764 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:34.000737    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"]
Jul 23 14:01:37.189849 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:37.187193    2581 scope.go:117] "RemoveContainer" containerID="763a4fc3329a7fa19ce97d42baa53c85083d239b617443ac0daa5a7bd2cccecb"
Jul 23 14:01:37.200349 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:37.200324    2581 scope.go:117] "RemoveContainer" containerID="d4f39d5aa62363ce046752dcb929481100496c2ee641ecd0018860d2d8a70220"
Jul 23 14:01:44.916659 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:44.916629    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:01:49.020768 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.020730    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb" podUID="fc5a6c44-9720-4d26-bb87-adc751e719b0" containerName="main" containerID="cri-o://3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3" gracePeriod=45
Jul 23 14:01:49.268711 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.268688    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:01:49.422892 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.422857    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-home\") pod \"fc5a6c44-9720-4d26-bb87-adc751e719b0\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") "
Jul 23 14:01:49.423041 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.422931    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5a6c44-9720-4d26-bb87-adc751e719b0-tls-certs\") pod \"fc5a6c44-9720-4d26-bb87-adc751e719b0\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") "
Jul 23 14:01:49.423041 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.422978    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-model-cache\") pod \"fc5a6c44-9720-4d26-bb87-adc751e719b0\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") "
Jul 23 14:01:49.423041 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.422999    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-dshm\") pod \"fc5a6c44-9720-4d26-bb87-adc751e719b0\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") "
Jul 23 14:01:49.423041 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-tmp-dir\") pod \"fc5a6c44-9720-4d26-bb87-adc751e719b0\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") "
Jul 23 14:01:49.423256 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqbmv\" (UniqueName: \"kubernetes.io/projected/fc5a6c44-9720-4d26-bb87-adc751e719b0-kube-api-access-hqbmv\") pod \"fc5a6c44-9720-4d26-bb87-adc751e719b0\" (UID: \"fc5a6c44-9720-4d26-bb87-adc751e719b0\") "
Jul 23 14:01:49.423256 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423125    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-home" (OuterVolumeSpecName: "home") pod "fc5a6c44-9720-4d26-bb87-adc751e719b0" (UID: "fc5a6c44-9720-4d26-bb87-adc751e719b0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:01:49.423256 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423216    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc5a6c44-9720-4d26-bb87-adc751e719b0" (UID: "fc5a6c44-9720-4d26-bb87-adc751e719b0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:01:49.423404 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423352    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fc5a6c44-9720-4d26-bb87-adc751e719b0" (UID: "fc5a6c44-9720-4d26-bb87-adc751e719b0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:01:49.423404 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423372    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-model-cache\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:01:49.423404 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.423386    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-home\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:01:49.425223 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.425194    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc5a6c44-9720-4d26-bb87-adc751e719b0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fc5a6c44-9720-4d26-bb87-adc751e719b0" (UID: "fc5a6c44-9720-4d26-bb87-adc751e719b0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 14:01:49.425335 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.425223    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-dshm" (OuterVolumeSpecName: "dshm") pod "fc5a6c44-9720-4d26-bb87-adc751e719b0" (UID: "fc5a6c44-9720-4d26-bb87-adc751e719b0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 14:01:49.425335 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.425312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc5a6c44-9720-4d26-bb87-adc751e719b0-kube-api-access-hqbmv" (OuterVolumeSpecName: "kube-api-access-hqbmv") pod "fc5a6c44-9720-4d26-bb87-adc751e719b0" (UID: "fc5a6c44-9720-4d26-bb87-adc751e719b0"). InnerVolumeSpecName "kube-api-access-hqbmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:01:49.524391 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.524360    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-tmp-dir\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:01:49.524391 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.524387    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqbmv\" (UniqueName: \"kubernetes.io/projected/fc5a6c44-9720-4d26-bb87-adc751e719b0-kube-api-access-hqbmv\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:01:49.524391 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.524396    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fc5a6c44-9720-4d26-bb87-adc751e719b0-tls-certs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:01:49.524560 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:49.524404    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fc5a6c44-9720-4d26-bb87-adc751e719b0-dshm\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:01:50.069262 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.069236    2581 generic.go:356] "Generic (PLEG): container finished" podID="fc5a6c44-9720-4d26-bb87-adc751e719b0" containerID="3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3" exitCode=0
Jul 23 14:01:50.069659 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.069283    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"
Jul 23 14:01:50.069659 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.069324    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb" event={"ID":"fc5a6c44-9720-4d26-bb87-adc751e719b0","Type":"ContainerDied","Data":"3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3"}
Jul 23 14:01:50.069659 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.069373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb" event={"ID":"fc5a6c44-9720-4d26-bb87-adc751e719b0","Type":"ContainerDied","Data":"26ec0faebc3fd1119783c7ee44afb2c61daf1979919eed441dc1a3ef8ea8f344"}
Jul 23 14:01:50.069659 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.069397    2581 scope.go:117] "RemoveContainer" containerID="3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3"
Jul 23 14:01:50.085199 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.085178    2581 scope.go:117] "RemoveContainer" containerID="3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3"
Jul 23 14:01:50.085472 ip-10-0-141-235 kubenswrapper[2581]: E0723 14:01:50.085450    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3\": container with ID starting with 3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3 not found: ID does not exist" containerID="3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3"
Jul 23 14:01:50.085544 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.085484    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3"} err="failed to get container status \"3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3\": rpc error: code = NotFound desc = could not find container \"3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3\": container with ID starting with 3d9f693a2122b0bd58c3fad08d8f38d18399cd9b13dde01197720a83fd887ee3 not found: ID does not exist"
Jul 23 14:01:50.095765 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.095735    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"]
Jul 23 14:01:50.097924 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.097906    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0cb132/sub-test-model-0cb132-kserve-bc796b69-5v8mb"]
Jul 23 14:01:50.818437 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:01:50.818414    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc5a6c44-9720-4d26-bb87-adc751e719b0" path="/var/lib/kubelet/pods/fc5a6c44-9720-4d26-bb87-adc751e719b0/volumes"
Jul 23 14:02:02.910347 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:02:02.910312    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:02:34.316644 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:02:34.316613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:02:37.021794 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:02:37.021770    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 14:02:37.030773 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:02:37.030755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 14:02:37.223391 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:02:37.223369    2581 scope.go:117] "RemoveContainer" containerID="1fee1d3e53f56eb646b40c644ed12aa415b0e67995c89cf5eaaf0c60111b1ca8"
Jul 23 14:02:55.220766 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:02:55.220736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:03:10.747147 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:10.747114    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:03:19.000528 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.000500    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7875-139985083168432"]
Jul 23 14:03:19.000885 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.000875    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc5a6c44-9720-4d26-bb87-adc751e719b0" containerName="main"
Jul 23 14:03:19.000885 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.000885    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc5a6c44-9720-4d26-bb87-adc751e719b0" containerName="main"
Jul 23 14:03:19.000955 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.000948    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc5a6c44-9720-4d26-bb87-adc751e719b0" containerName="main"
Jul 23 14:03:19.003004 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.002988    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:19.005716 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.005695    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-g4kph\""
Jul 23 14:03:19.010424 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.010393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083168432"]
Jul 23 14:03:19.010950 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.010903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmgs\" (UniqueName: \"kubernetes.io/projected/8f7d4eb1-6197-481e-ac1c-44bce4c251a8-kube-api-access-rnmgs\") pod \"test-curl-7875-139985083168432\" (UID: \"8f7d4eb1-6197-481e-ac1c-44bce4c251a8\") " pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:19.111669 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.111638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmgs\" (UniqueName: \"kubernetes.io/projected/8f7d4eb1-6197-481e-ac1c-44bce4c251a8-kube-api-access-rnmgs\") pod \"test-curl-7875-139985083168432\" (UID: \"8f7d4eb1-6197-481e-ac1c-44bce4c251a8\") " pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:19.120305 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.120286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmgs\" (UniqueName: \"kubernetes.io/projected/8f7d4eb1-6197-481e-ac1c-44bce4c251a8-kube-api-access-rnmgs\") pod \"test-curl-7875-139985083168432\" (UID: \"8f7d4eb1-6197-481e-ac1c-44bce4c251a8\") " pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:19.313653 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.313599    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:19.442821 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.442795    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083168432"]
Jul 23 14:03:19.444815 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:19.444777    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f7d4eb1_6197_481e_ac1c_44bce4c251a8.slice/crio-5083ed3854058db6363ec943acba0ec32f45cad647bfdb4bc72dfd1489272dbd WatchSource:0}: Error finding container 5083ed3854058db6363ec943acba0ec32f45cad647bfdb4bc72dfd1489272dbd: Status 404 returned error can't find the container with id 5083ed3854058db6363ec943acba0ec32f45cad647bfdb4bc72dfd1489272dbd
Jul 23 14:03:19.446312 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.446293    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 14:03:19.507692 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:19.507669    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083168432" event={"ID":"8f7d4eb1-6197-481e-ac1c-44bce4c251a8","Type":"ContainerStarted","Data":"5083ed3854058db6363ec943acba0ec32f45cad647bfdb4bc72dfd1489272dbd"}
Jul 23 14:03:20.514002 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:20.513904    2581 generic.go:356] "Generic (PLEG): container finished" podID="8f7d4eb1-6197-481e-ac1c-44bce4c251a8" containerID="f0a6d2f655069bdd50d6dc3c2be73b8e03ac188f2b596d21f5fa7a303064044d" exitCode=0
Jul 23 14:03:20.514002 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:20.513966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083168432" event={"ID":"8f7d4eb1-6197-481e-ac1c-44bce4c251a8","Type":"ContainerDied","Data":"f0a6d2f655069bdd50d6dc3c2be73b8e03ac188f2b596d21f5fa7a303064044d"}
Jul 23 14:03:21.645262 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.645240    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:21.683367 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.683348    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7875-139985083168432_8f7d4eb1-6197-481e-ac1c-44bce4c251a8/test-curl-7875-139985083168432/0.log"
Jul 23 14:03:21.707910 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.707885    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7875-139985083168432"]
Jul 23 14:03:21.713845 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.713826    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7875-139985083168432"]
Jul 23 14:03:21.730352 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.730332    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rnmgs\" (UniqueName: \"kubernetes.io/projected/8f7d4eb1-6197-481e-ac1c-44bce4c251a8-kube-api-access-rnmgs\") pod \"8f7d4eb1-6197-481e-ac1c-44bce4c251a8\" (UID: \"8f7d4eb1-6197-481e-ac1c-44bce4c251a8\") "
Jul 23 14:03:21.732538 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.732511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f7d4eb1-6197-481e-ac1c-44bce4c251a8-kube-api-access-rnmgs" (OuterVolumeSpecName: "kube-api-access-rnmgs") pod "8f7d4eb1-6197-481e-ac1c-44bce4c251a8" (UID: "8f7d4eb1-6197-481e-ac1c-44bce4c251a8"). InnerVolumeSpecName "kube-api-access-rnmgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:21.831372 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.831323    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rnmgs\" (UniqueName: \"kubernetes.io/projected/8f7d4eb1-6197-481e-ac1c-44bce4c251a8-kube-api-access-rnmgs\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:21.846559 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.846537    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7875-139985083170096"]
Jul 23 14:03:21.846939 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.846927    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f7d4eb1-6197-481e-ac1c-44bce4c251a8" containerName="test-curl-7875-139985083168432"
Jul 23 14:03:21.846986 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.846942    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f7d4eb1-6197-481e-ac1c-44bce4c251a8" containerName="test-curl-7875-139985083168432"
Jul 23 14:03:21.847021 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.847012    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f7d4eb1-6197-481e-ac1c-44bce4c251a8" containerName="test-curl-7875-139985083168432"
Jul 23 14:03:21.849373 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.849357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:21.857302 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.857282    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083170096"]
Jul 23 14:03:21.931852 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:21.931832    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6gdx\" (UniqueName: \"kubernetes.io/projected/9753256d-6ea0-4991-9789-c86ab1f8f708-kube-api-access-f6gdx\") pod \"test-curl-7875-139985083170096\" (UID: \"9753256d-6ea0-4991-9789-c86ab1f8f708\") " pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:22.033039 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.033010    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6gdx\" (UniqueName: \"kubernetes.io/projected/9753256d-6ea0-4991-9789-c86ab1f8f708-kube-api-access-f6gdx\") pod \"test-curl-7875-139985083170096\" (UID: \"9753256d-6ea0-4991-9789-c86ab1f8f708\") " pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:22.042449 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.042431    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6gdx\" (UniqueName: \"kubernetes.io/projected/9753256d-6ea0-4991-9789-c86ab1f8f708-kube-api-access-f6gdx\") pod \"test-curl-7875-139985083170096\" (UID: \"9753256d-6ea0-4991-9789-c86ab1f8f708\") " pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:22.159308 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.159293    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:22.287883 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.287860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083170096"]
Jul 23 14:03:22.289584 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:22.289553    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9753256d_6ea0_4991_9789_c86ab1f8f708.slice/crio-8c945b776770ee4e8724d74e2431aa7abe71a3ed7bad2e265ede467c22eb1d79 WatchSource:0}: Error finding container 8c945b776770ee4e8724d74e2431aa7abe71a3ed7bad2e265ede467c22eb1d79: Status 404 returned error can't find the container with id 8c945b776770ee4e8724d74e2431aa7abe71a3ed7bad2e265ede467c22eb1d79
Jul 23 14:03:22.525037 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.524973    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:22.525037 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.525021    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5083ed3854058db6363ec943acba0ec32f45cad647bfdb4bc72dfd1489272dbd"
Jul 23 14:03:22.526256 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.526233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083170096" event={"ID":"9753256d-6ea0-4991-9789-c86ab1f8f708","Type":"ContainerStarted","Data":"8c945b776770ee4e8724d74e2431aa7abe71a3ed7bad2e265ede467c22eb1d79"}
Jul 23 14:03:22.535716 ip-10-0-141-235 kubenswrapper[2581]: E0723 14:03:22.535691    2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7875-139985083168432\" is forbidden: User \"system:node:ip-10-0-141-235.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-235.ec2.internal' and this object" podUID="8f7d4eb1-6197-481e-ac1c-44bce4c251a8" pod="opendatahub/test-curl-7875-139985083168432"
Jul 23 14:03:22.817977 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:22.817919    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f7d4eb1-6197-481e-ac1c-44bce4c251a8" path="/var/lib/kubelet/pods/8f7d4eb1-6197-481e-ac1c-44bce4c251a8/volumes"
Jul 23 14:03:23.532481 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:23.532450    2581 generic.go:356] "Generic (PLEG): container finished" podID="9753256d-6ea0-4991-9789-c86ab1f8f708" containerID="6ad55ac9fa194c46e44ac69465dbc8b40b51c8e304d5e4422e04625b148c15ad" exitCode=0
Jul 23 14:03:23.532634 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:23.532533    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083170096" event={"ID":"9753256d-6ea0-4991-9789-c86ab1f8f708","Type":"ContainerDied","Data":"6ad55ac9fa194c46e44ac69465dbc8b40b51c8e304d5e4422e04625b148c15ad"}
Jul 23 14:03:24.664223 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.664203    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:24.686307 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.686285    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7875-139985083170096_9753256d-6ea0-4991-9789-c86ab1f8f708/test-curl-7875-139985083170096/0.log"
Jul 23 14:03:24.710611 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.710588    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7875-139985083170096"]
Jul 23 14:03:24.712774 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.712755    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7875-139985083170096"]
Jul 23 14:03:24.753279 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.753253    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6gdx\" (UniqueName: \"kubernetes.io/projected/9753256d-6ea0-4991-9789-c86ab1f8f708-kube-api-access-f6gdx\") pod \"9753256d-6ea0-4991-9789-c86ab1f8f708\" (UID: \"9753256d-6ea0-4991-9789-c86ab1f8f708\") "
Jul 23 14:03:24.755296 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.755267    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9753256d-6ea0-4991-9789-c86ab1f8f708-kube-api-access-f6gdx" (OuterVolumeSpecName: "kube-api-access-f6gdx") pod "9753256d-6ea0-4991-9789-c86ab1f8f708" (UID: "9753256d-6ea0-4991-9789-c86ab1f8f708"). InnerVolumeSpecName "kube-api-access-f6gdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:24.817706 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.817653    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9753256d-6ea0-4991-9789-c86ab1f8f708" path="/var/lib/kubelet/pods/9753256d-6ea0-4991-9789-c86ab1f8f708/volumes"
Jul 23 14:03:24.854784 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.854759    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6gdx\" (UniqueName: \"kubernetes.io/projected/9753256d-6ea0-4991-9789-c86ab1f8f708-kube-api-access-f6gdx\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:24.883550 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.883530    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:24.883911 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.883899    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9753256d-6ea0-4991-9789-c86ab1f8f708" containerName="test-curl-7875-139985083170096"
Jul 23 14:03:24.883952 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.883912    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9753256d-6ea0-4991-9789-c86ab1f8f708" containerName="test-curl-7875-139985083170096"
Jul 23 14:03:24.884017 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.884006    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9753256d-6ea0-4991-9789-c86ab1f8f708" containerName="test-curl-7875-139985083170096"
Jul 23 14:03:24.886051 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.886037    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:24.890766 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.890748    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:24.955139 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:24.955116    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gpr7\" (UniqueName: \"kubernetes.io/projected/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88-kube-api-access-8gpr7\") pod \"test-curl-7875-139985083253648\" (UID: \"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88\") " pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:25.056456 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.056432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gpr7\" (UniqueName: \"kubernetes.io/projected/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88-kube-api-access-8gpr7\") pod \"test-curl-7875-139985083253648\" (UID: \"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88\") " pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:25.065536 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.065519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gpr7\" (UniqueName: \"kubernetes.io/projected/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88-kube-api-access-8gpr7\") pod \"test-curl-7875-139985083253648\" (UID: \"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88\") " pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:25.194843 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.194823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:25.326500 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.326467    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:25.328126 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:25.328077    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3ae2fbf_ce7b_489c_bd8b_29ebaa09ea88.slice/crio-3faed15fbc73c551d2bf94c6a2d08c3259d5b90eddf8de53e0fb51f1d63a5e3b WatchSource:0}: Error finding container 3faed15fbc73c551d2bf94c6a2d08c3259d5b90eddf8de53e0fb51f1d63a5e3b: Status 404 returned error can't find the container with id 3faed15fbc73c551d2bf94c6a2d08c3259d5b90eddf8de53e0fb51f1d63a5e3b
Jul 23 14:03:25.543812 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.543744    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083253648" event={"ID":"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88","Type":"ContainerStarted","Data":"3faed15fbc73c551d2bf94c6a2d08c3259d5b90eddf8de53e0fb51f1d63a5e3b"}
Jul 23 14:03:25.544839 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.544822    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083170096"
Jul 23 14:03:25.544930 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:25.544873    2581 scope.go:117] "RemoveContainer" containerID="6ad55ac9fa194c46e44ac69465dbc8b40b51c8e304d5e4422e04625b148c15ad"
Jul 23 14:03:26.550828 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:26.550792    2581 generic.go:356] "Generic (PLEG): container finished" podID="b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" containerID="eeff2adc278a7d6ae4afed07c64821acb927bfa93aa354c41a11af0e60a051ce" exitCode=0
Jul 23 14:03:26.551280 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:26.550877    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083253648" event={"ID":"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88","Type":"ContainerDied","Data":"eeff2adc278a7d6ae4afed07c64821acb927bfa93aa354c41a11af0e60a051ce"}
Jul 23 14:03:27.693602 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.693579    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:27.724552 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.724520    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7875-139985083253648_b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88/test-curl-7875-139985083253648/0.log"
Jul 23 14:03:27.751445 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.751422    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:27.755077 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.755052    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:27.775632 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.775610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gpr7\" (UniqueName: \"kubernetes.io/projected/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88-kube-api-access-8gpr7\") pod \"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88\" (UID: \"b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88\") "
Jul 23 14:03:27.777624 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.777603    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88-kube-api-access-8gpr7" (OuterVolumeSpecName: "kube-api-access-8gpr7") pod "b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" (UID: "b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88"). InnerVolumeSpecName "kube-api-access-8gpr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:27.876401 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.876384    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gpr7\" (UniqueName: \"kubernetes.io/projected/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88-kube-api-access-8gpr7\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:27.893929 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.893910    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:27.894336 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.894323    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" containerName="test-curl-7875-139985083253648"
Jul 23 14:03:27.894379 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.894342    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" containerName="test-curl-7875-139985083253648"
Jul 23 14:03:27.894426 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.894415    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" containerName="test-curl-7875-139985083253648"
Jul 23 14:03:27.896494 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.896480    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:27.905562 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.905540    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:27.977584 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:27.977559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzjkv\" (UniqueName: \"kubernetes.io/projected/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82-kube-api-access-fzjkv\") pod \"test-curl-7875-139985083253648\" (UID: \"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82\") " pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:28.078276 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.078249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzjkv\" (UniqueName: \"kubernetes.io/projected/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82-kube-api-access-fzjkv\") pod \"test-curl-7875-139985083253648\" (UID: \"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82\") " pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:28.088394 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.088374    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzjkv\" (UniqueName: \"kubernetes.io/projected/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82-kube-api-access-fzjkv\") pod \"test-curl-7875-139985083253648\" (UID: \"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82\") " pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:28.205191 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.205123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:28.538673 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.538650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:28.540319 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:28.540293    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c492b3d_15a0_4d5f_b2a6_25fb02f28d82.slice/crio-7b1b22a4c516d935523fe1fc2eeba26206e7ab019790dc4c74bf7eabd22e1cf0 WatchSource:0}: Error finding container 7b1b22a4c516d935523fe1fc2eeba26206e7ab019790dc4c74bf7eabd22e1cf0: Status 404 returned error can't find the container with id 7b1b22a4c516d935523fe1fc2eeba26206e7ab019790dc4c74bf7eabd22e1cf0
Jul 23 14:03:28.562944 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.562925    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3faed15fbc73c551d2bf94c6a2d08c3259d5b90eddf8de53e0fb51f1d63a5e3b"
Jul 23 14:03:28.562944 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.562926    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:28.564129 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.564080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083253648" event={"ID":"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82","Type":"ContainerStarted","Data":"7b1b22a4c516d935523fe1fc2eeba26206e7ab019790dc4c74bf7eabd22e1cf0"}
Jul 23 14:03:28.575229 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.575205    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7875-139985083253648" oldPodUID="b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" podUID="7c492b3d-15a0-4d5f-b2a6-25fb02f28d82"
Jul 23 14:03:28.817394 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:28.817374    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88" path="/var/lib/kubelet/pods/b3ae2fbf-ce7b-489c-bd8b-29ebaa09ea88/volumes"
Jul 23 14:03:29.571750 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:29.571722    2581 generic.go:356] "Generic (PLEG): container finished" podID="7c492b3d-15a0-4d5f-b2a6-25fb02f28d82" containerID="40cf714841ebc35acee8d9c2686cbf052d25d8622d5e3b0f7c67f8f443baf541" exitCode=0
Jul 23 14:03:29.571958 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:29.571806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083253648" event={"ID":"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82","Type":"ContainerDied","Data":"40cf714841ebc35acee8d9c2686cbf052d25d8622d5e3b0f7c67f8f443baf541"}
Jul 23 14:03:30.421020 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.420984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:03:30.710832 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.710810    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:30.731381 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.731355    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7875-139985083253648_7c492b3d-15a0-4d5f-b2a6-25fb02f28d82/test-curl-7875-139985083253648/0.log"
Jul 23 14:03:30.755188 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.755162    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:30.759639 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.759619    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7875-139985083253648"]
Jul 23 14:03:30.801228 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.801210    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzjkv\" (UniqueName: \"kubernetes.io/projected/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82-kube-api-access-fzjkv\") pod \"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82\" (UID: \"7c492b3d-15a0-4d5f-b2a6-25fb02f28d82\") "
Jul 23 14:03:30.803342 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.803325    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82-kube-api-access-fzjkv" (OuterVolumeSpecName: "kube-api-access-fzjkv") pod "7c492b3d-15a0-4d5f-b2a6-25fb02f28d82" (UID: "7c492b3d-15a0-4d5f-b2a6-25fb02f28d82"). InnerVolumeSpecName "kube-api-access-fzjkv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:30.817279 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.817260    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c492b3d-15a0-4d5f-b2a6-25fb02f28d82" path="/var/lib/kubelet/pods/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82/volumes"
Jul 23 14:03:30.878821 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.878801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:30.879203 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.879190    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c492b3d-15a0-4d5f-b2a6-25fb02f28d82" containerName="test-curl-7875-139985083253648"
Jul 23 14:03:30.879249 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.879204    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c492b3d-15a0-4d5f-b2a6-25fb02f28d82" containerName="test-curl-7875-139985083253648"
Jul 23 14:03:30.879283 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.879260    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c492b3d-15a0-4d5f-b2a6-25fb02f28d82" containerName="test-curl-7875-139985083253648"
Jul 23 14:03:30.881527 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.881514    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:30.888989 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.888968    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:30.902162 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.902138    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kb9j6\" (UniqueName: \"kubernetes.io/projected/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda-kube-api-access-kb9j6\") pod \"test-curl-7875-139985083139536\" (UID: \"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda\") " pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:30.902245 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:30.902233    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzjkv\" (UniqueName: \"kubernetes.io/projected/7c492b3d-15a0-4d5f-b2a6-25fb02f28d82-kube-api-access-fzjkv\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:31.002905 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.002853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kb9j6\" (UniqueName: \"kubernetes.io/projected/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda-kube-api-access-kb9j6\") pod \"test-curl-7875-139985083139536\" (UID: \"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda\") " pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:31.010885 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.010860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kb9j6\" (UniqueName: \"kubernetes.io/projected/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda-kube-api-access-kb9j6\") pod \"test-curl-7875-139985083139536\" (UID: \"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda\") " pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:31.191655 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.191630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:31.320170 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.320144    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:31.322016 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:31.321992    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ffb381b_30cc_431e_8f4e_fb2d76a3bbda.slice/crio-0f40c93cbd3dfa5a380b6502ee4ebc3d6cc8bc8f982cb062ebbd0e10c1532988 WatchSource:0}: Error finding container 0f40c93cbd3dfa5a380b6502ee4ebc3d6cc8bc8f982cb062ebbd0e10c1532988: Status 404 returned error can't find the container with id 0f40c93cbd3dfa5a380b6502ee4ebc3d6cc8bc8f982cb062ebbd0e10c1532988
Jul 23 14:03:31.583631 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.583563    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083253648"
Jul 23 14:03:31.584013 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.583617    2581 scope.go:117] "RemoveContainer" containerID="40cf714841ebc35acee8d9c2686cbf052d25d8622d5e3b0f7c67f8f443baf541"
Jul 23 14:03:31.584833 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:31.584772    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083139536" event={"ID":"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda","Type":"ContainerStarted","Data":"0f40c93cbd3dfa5a380b6502ee4ebc3d6cc8bc8f982cb062ebbd0e10c1532988"}
Jul 23 14:03:32.590955 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:32.590921    2581 generic.go:356] "Generic (PLEG): container finished" podID="8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" containerID="c167f106f8112d2346e3dbe8951e30fd36b1c560ee8249e57e876abdfa393f77" exitCode=0
Jul 23 14:03:32.591369 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:32.591010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083139536" event={"ID":"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda","Type":"ContainerDied","Data":"c167f106f8112d2346e3dbe8951e30fd36b1c560ee8249e57e876abdfa393f77"}
Jul 23 14:03:33.728827 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.728805    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:33.749515 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.749496    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7875-139985083139536_8ffb381b-30cc-431e-8f4e-fb2d76a3bbda/test-curl-7875-139985083139536/0.log"
Jul 23 14:03:33.772259 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.772235    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:33.776009 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.775983    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:33.824686 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.824666    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kb9j6\" (UniqueName: \"kubernetes.io/projected/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda-kube-api-access-kb9j6\") pod \"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda\" (UID: \"8ffb381b-30cc-431e-8f4e-fb2d76a3bbda\") "
Jul 23 14:03:33.826686 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.826661    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda-kube-api-access-kb9j6" (OuterVolumeSpecName: "kube-api-access-kb9j6") pod "8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" (UID: "8ffb381b-30cc-431e-8f4e-fb2d76a3bbda"). InnerVolumeSpecName "kube-api-access-kb9j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:33.901238 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.901214    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:33.901610 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.901598    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" containerName="test-curl-7875-139985083139536"
Jul 23 14:03:33.901653 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.901612    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" containerName="test-curl-7875-139985083139536"
Jul 23 14:03:33.901685 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.901668    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" containerName="test-curl-7875-139985083139536"
Jul 23 14:03:33.903888 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.903874    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:33.910944 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.910921    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:33.925656 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.925630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7hqk\" (UniqueName: \"kubernetes.io/projected/bf1d1e38-4d75-4d1a-94d8-528af756b436-kube-api-access-v7hqk\") pod \"test-curl-7875-139985083139536\" (UID: \"bf1d1e38-4d75-4d1a-94d8-528af756b436\") " pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:33.925743 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:33.925730    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kb9j6\" (UniqueName: \"kubernetes.io/projected/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda-kube-api-access-kb9j6\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:34.026989 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.026964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7hqk\" (UniqueName: \"kubernetes.io/projected/bf1d1e38-4d75-4d1a-94d8-528af756b436-kube-api-access-v7hqk\") pod \"test-curl-7875-139985083139536\" (UID: \"bf1d1e38-4d75-4d1a-94d8-528af756b436\") " pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:34.035824 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.035797    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7hqk\" (UniqueName: \"kubernetes.io/projected/bf1d1e38-4d75-4d1a-94d8-528af756b436-kube-api-access-v7hqk\") pod \"test-curl-7875-139985083139536\" (UID: \"bf1d1e38-4d75-4d1a-94d8-528af756b436\") " pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:34.214541 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.214486    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:34.342653 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.342630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:34.344415 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:34.344390    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbf1d1e38_4d75_4d1a_94d8_528af756b436.slice/crio-56c65e2472b87a9f1d41286d947b3bccc70cfc9f6202db87aa1c8a839912cee0 WatchSource:0}: Error finding container 56c65e2472b87a9f1d41286d947b3bccc70cfc9f6202db87aa1c8a839912cee0: Status 404 returned error can't find the container with id 56c65e2472b87a9f1d41286d947b3bccc70cfc9f6202db87aa1c8a839912cee0
Jul 23 14:03:34.603137 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.603073    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f40c93cbd3dfa5a380b6502ee4ebc3d6cc8bc8f982cb062ebbd0e10c1532988"
Jul 23 14:03:34.603137 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.603075    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:34.604177 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.604154    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083139536" event={"ID":"bf1d1e38-4d75-4d1a-94d8-528af756b436","Type":"ContainerStarted","Data":"56c65e2472b87a9f1d41286d947b3bccc70cfc9f6202db87aa1c8a839912cee0"}
Jul 23 14:03:34.615621 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.615599    2581 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7875-139985083139536" oldPodUID="8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" podUID="bf1d1e38-4d75-4d1a-94d8-528af756b436"
Jul 23 14:03:34.817409 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:34.817382    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ffb381b-30cc-431e-8f4e-fb2d76a3bbda" path="/var/lib/kubelet/pods/8ffb381b-30cc-431e-8f4e-fb2d76a3bbda/volumes"
Jul 23 14:03:35.610202 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:35.610164    2581 generic.go:356] "Generic (PLEG): container finished" podID="bf1d1e38-4d75-4d1a-94d8-528af756b436" containerID="cd414568f1dba40715840822274e7a7e4f8072098629dbcc516ea77d8609cfc7" exitCode=0
Jul 23 14:03:35.610354 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:35.610250    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7875-139985083139536" event={"ID":"bf1d1e38-4d75-4d1a-94d8-528af756b436","Type":"ContainerDied","Data":"cd414568f1dba40715840822274e7a7e4f8072098629dbcc516ea77d8609cfc7"}
Jul 23 14:03:36.751260 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.751236    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:36.774124 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.774052    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7875-139985083139536_bf1d1e38-4d75-4d1a-94d8-528af756b436/test-curl-7875-139985083139536/0.log"
Jul 23 14:03:36.798445 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.798420    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:36.802197 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.802180    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7875-139985083139536"]
Jul 23 14:03:36.852315 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.852281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7hqk\" (UniqueName: \"kubernetes.io/projected/bf1d1e38-4d75-4d1a-94d8-528af756b436-kube-api-access-v7hqk\") pod \"bf1d1e38-4d75-4d1a-94d8-528af756b436\" (UID: \"bf1d1e38-4d75-4d1a-94d8-528af756b436\") "
Jul 23 14:03:36.854197 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.854170    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf1d1e38-4d75-4d1a-94d8-528af756b436-kube-api-access-v7hqk" (OuterVolumeSpecName: "kube-api-access-v7hqk") pod "bf1d1e38-4d75-4d1a-94d8-528af756b436" (UID: "bf1d1e38-4d75-4d1a-94d8-528af756b436"). InnerVolumeSpecName "kube-api-access-v7hqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:36.953745 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:36.953724    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7hqk\" (UniqueName: \"kubernetes.io/projected/bf1d1e38-4d75-4d1a-94d8-528af756b436-kube-api-access-v7hqk\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:37.005220 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.005198    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"]
Jul 23 14:03:37.005557 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.005546    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf1d1e38-4d75-4d1a-94d8-528af756b436" containerName="test-curl-7875-139985083139536"
Jul 23 14:03:37.005609 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.005559    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf1d1e38-4d75-4d1a-94d8-528af756b436" containerName="test-curl-7875-139985083139536"
Jul 23 14:03:37.005652 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.005642    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf1d1e38-4d75-4d1a-94d8-528af756b436" containerName="test-curl-7875-139985083139536"
Jul 23 14:03:37.007674 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.007661    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:37.010457 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.010443    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 14:03:37.015758 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.015732    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"]
Jul 23 14:03:37.054931 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.054904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ae6f7b-573f-4c47-915d-a8d091adf53a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l\" (UID: \"a6ae6f7b-573f-4c47-915d-a8d091adf53a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:37.155542 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.155519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ae6f7b-573f-4c47-915d-a8d091adf53a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l\" (UID: \"a6ae6f7b-573f-4c47-915d-a8d091adf53a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:37.156026 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.156010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ae6f7b-573f-4c47-915d-a8d091adf53a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l\" (UID: \"a6ae6f7b-573f-4c47-915d-a8d091adf53a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:37.246528 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.246470    2581 scope.go:117] "RemoveContainer" containerID="066be7481792d86dd8e6ae90647d60543569c3f81bb78ea29080a1c11bd11fc6"
Jul 23 14:03:37.319783 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.319765    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:37.621362 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.621336    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7875-139985083139536"
Jul 23 14:03:37.621508 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.621401    2581 scope.go:117] "RemoveContainer" containerID="cd414568f1dba40715840822274e7a7e4f8072098629dbcc516ea77d8609cfc7"
Jul 23 14:03:37.678410 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:37.678390    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"]
Jul 23 14:03:37.679783 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:37.679760    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6ae6f7b_573f_4c47_915d_a8d091adf53a.slice/crio-e5b9d7b7327fae6ecb3a8d7eabb83054bd9142203f4f06b1205d7669fe44474f WatchSource:0}: Error finding container e5b9d7b7327fae6ecb3a8d7eabb83054bd9142203f4f06b1205d7669fe44474f: Status 404 returned error can't find the container with id e5b9d7b7327fae6ecb3a8d7eabb83054bd9142203f4f06b1205d7669fe44474f
Jul 23 14:03:38.628176 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:38.628146    2581 generic.go:356] "Generic (PLEG): container finished" podID="a6ae6f7b-573f-4c47-915d-a8d091adf53a" containerID="3191a183d256d6f03bab547a422abaa8403a843014a8be81a3a1ef5d5de2c745" exitCode=0
Jul 23 14:03:38.628487 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:38.628227    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l" event={"ID":"a6ae6f7b-573f-4c47-915d-a8d091adf53a","Type":"ContainerDied","Data":"3191a183d256d6f03bab547a422abaa8403a843014a8be81a3a1ef5d5de2c745"}
Jul 23 14:03:38.628487 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:38.628285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l" event={"ID":"a6ae6f7b-573f-4c47-915d-a8d091adf53a","Type":"ContainerStarted","Data":"e5b9d7b7327fae6ecb3a8d7eabb83054bd9142203f4f06b1205d7669fe44474f"}
Jul 23 14:03:38.817761 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:38.817700    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf1d1e38-4d75-4d1a-94d8-528af756b436" path="/var/lib/kubelet/pods/bf1d1e38-4d75-4d1a-94d8-528af756b436/volumes"
Jul 23 14:03:39.766963 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:39.766943    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:39.878031 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:39.878006    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ae6f7b-573f-4c47-915d-a8d091adf53a-maas-api-service-ca\") pod \"a6ae6f7b-573f-4c47-915d-a8d091adf53a\" (UID: \"a6ae6f7b-573f-4c47-915d-a8d091adf53a\") "
Jul 23 14:03:39.878452 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:39.878433    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ae6f7b-573f-4c47-915d-a8d091adf53a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a6ae6f7b-573f-4c47-915d-a8d091adf53a" (UID: "a6ae6f7b-573f-4c47-915d-a8d091adf53a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:03:39.979602 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:39.979535    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6ae6f7b-573f-4c47-915d-a8d091adf53a-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:40.638939 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:40.638912    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"
Jul 23 14:03:40.639180 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:40.638944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l" event={"ID":"a6ae6f7b-573f-4c47-915d-a8d091adf53a","Type":"ContainerDied","Data":"e5b9d7b7327fae6ecb3a8d7eabb83054bd9142203f4f06b1205d7669fe44474f"}
Jul 23 14:03:40.639180 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:40.639005    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5b9d7b7327fae6ecb3a8d7eabb83054bd9142203f4f06b1205d7669fe44474f"
Jul 23 14:03:47.504705 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.504671    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"]
Jul 23 14:03:47.505263 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.504910    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg" podUID="4dcced16-0d4f-4132-8f86-d0034aa0cac6" containerName="maas-api" containerID="cri-o://9428e9ba557e6e1676a7463827715babb0093517e1538150f7bb716637058225" gracePeriod=30
Jul 23 14:03:47.534365 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.534336    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"]
Jul 23 14:03:47.539760 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.539732    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-0cb132-29746920-kvftt"]
Jul 23 14:03:47.676491 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.676444    2581 generic.go:356] "Generic (PLEG): container finished" podID="4dcced16-0d4f-4132-8f86-d0034aa0cac6" containerID="9428e9ba557e6e1676a7463827715babb0093517e1538150f7bb716637058225" exitCode=0
Jul 23 14:03:47.676646 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.676540    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg" event={"ID":"4dcced16-0d4f-4132-8f86-d0034aa0cac6","Type":"ContainerDied","Data":"9428e9ba557e6e1676a7463827715babb0093517e1538150f7bb716637058225"}
Jul 23 14:03:47.751712 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.751692    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 14:03:47.847387 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.847326    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcced16-0d4f-4132-8f86-d0034aa0cac6-openshift-service-ca\") pod \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") "
Jul 23 14:03:47.847507 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.847414    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dcced16-0d4f-4132-8f86-d0034aa0cac6-maas-api-tls\") pod \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") "
Jul 23 14:03:47.847507 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.847467    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvcr7\" (UniqueName: \"kubernetes.io/projected/4dcced16-0d4f-4132-8f86-d0034aa0cac6-kube-api-access-kvcr7\") pod \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\" (UID: \"4dcced16-0d4f-4132-8f86-d0034aa0cac6\") "
Jul 23 14:03:47.847714 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.847693    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dcced16-0d4f-4132-8f86-d0034aa0cac6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4dcced16-0d4f-4132-8f86-d0034aa0cac6" (UID: "4dcced16-0d4f-4132-8f86-d0034aa0cac6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:03:47.849525 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.849499    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4dcced16-0d4f-4132-8f86-d0034aa0cac6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4dcced16-0d4f-4132-8f86-d0034aa0cac6" (UID: "4dcced16-0d4f-4132-8f86-d0034aa0cac6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 14:03:47.849624 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.849604    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dcced16-0d4f-4132-8f86-d0034aa0cac6-kube-api-access-kvcr7" (OuterVolumeSpecName: "kube-api-access-kvcr7") pod "4dcced16-0d4f-4132-8f86-d0034aa0cac6" (UID: "4dcced16-0d4f-4132-8f86-d0034aa0cac6"). InnerVolumeSpecName "kube-api-access-kvcr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 14:03:47.948415 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.948388    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvcr7\" (UniqueName: \"kubernetes.io/projected/4dcced16-0d4f-4132-8f86-d0034aa0cac6-kube-api-access-kvcr7\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:47.948529 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.948418    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4dcced16-0d4f-4132-8f86-d0034aa0cac6-openshift-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:47.948529 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:47.948432    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4dcced16-0d4f-4132-8f86-d0034aa0cac6-maas-api-tls\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:03:48.682031 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.682008    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"
Jul 23 14:03:48.682432 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.682007    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg" event={"ID":"4dcced16-0d4f-4132-8f86-d0034aa0cac6","Type":"ContainerDied","Data":"c89439980c927ed24c49a7f0efa0e39d409ea7798d98a79c1abdbb671273a90b"}
Jul 23 14:03:48.682432 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.682142    2581 scope.go:117] "RemoveContainer" containerID="9428e9ba557e6e1676a7463827715babb0093517e1538150f7bb716637058225"
Jul 23 14:03:48.708456 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.708424    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"]
Jul 23 14:03:48.714479 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.714460    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0cb132-86b8dc64bc-fk4fg"]
Jul 23 14:03:48.817127 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.817078    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="245ae05d-a9b6-428c-ae8d-477b5842da6c" path="/var/lib/kubelet/pods/245ae05d-a9b6-428c-ae8d-477b5842da6c/volumes"
Jul 23 14:03:48.817456 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:48.817444    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dcced16-0d4f-4132-8f86-d0034aa0cac6" path="/var/lib/kubelet/pods/4dcced16-0d4f-4132-8f86-d0034aa0cac6/volumes"
Jul 23 14:03:50.419869 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:50.419834    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:03:52.090360 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:52.090330    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"]
Jul 23 14:03:52.094449 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:52.094425    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-0cb132-fcm9l"]
Jul 23 14:03:52.817514 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:52.817480    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6ae6f7b-573f-4c47-915d-a8d091adf53a" path="/var/lib/kubelet/pods/a6ae6f7b-573f-4c47-915d-a8d091adf53a/volumes"
Jul 23 14:03:59.317118 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317002    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"]
Jul 23 14:03:59.317645 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317597    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dcced16-0d4f-4132-8f86-d0034aa0cac6" containerName="maas-api"
Jul 23 14:03:59.317645 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317615    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dcced16-0d4f-4132-8f86-d0034aa0cac6" containerName="maas-api"
Jul 23 14:03:59.317645 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317642    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6ae6f7b-573f-4c47-915d-a8d091adf53a" containerName="revoke-keys"
Jul 23 14:03:59.317866 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317652    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6ae6f7b-573f-4c47-915d-a8d091adf53a" containerName="revoke-keys"
Jul 23 14:03:59.317866 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317750    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dcced16-0d4f-4132-8f86-d0034aa0cac6" containerName="maas-api"
Jul 23 14:03:59.317866 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.317761    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6ae6f7b-573f-4c47-915d-a8d091adf53a" containerName="revoke-keys"
Jul 23 14:03:59.322377 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.322357    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:03:59.326238 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.326210    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bnln8\""
Jul 23 14:03:59.326477 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.326461    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 14:03:59.327497 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.327469    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"]
Jul 23 14:03:59.450261 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.450239    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d35991-154d-4780-a419-34cc7a4354d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz\" (UID: \"06d35991-154d-4780-a419-34cc7a4354d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:03:59.551210 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.551186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d35991-154d-4780-a419-34cc7a4354d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz\" (UID: \"06d35991-154d-4780-a419-34cc7a4354d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:03:59.551706 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.551690    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d35991-154d-4780-a419-34cc7a4354d7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz\" (UID: \"06d35991-154d-4780-a419-34cc7a4354d7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:03:59.633651 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.633627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:03:59.766227 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:03:59.766160    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"]
Jul 23 14:03:59.767852 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:03:59.767831    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d35991_154d_4780_a419_34cc7a4354d7.slice/crio-65581026ca6677d51940d067f87e21e85f7eedb56dbb7471b10c62029725f817 WatchSource:0}: Error finding container 65581026ca6677d51940d067f87e21e85f7eedb56dbb7471b10c62029725f817: Status 404 returned error can't find the container with id 65581026ca6677d51940d067f87e21e85f7eedb56dbb7471b10c62029725f817
Jul 23 14:04:00.746680 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:00.746618    2581 generic.go:356] "Generic (PLEG): container finished" podID="06d35991-154d-4780-a419-34cc7a4354d7" containerID="377a6b2d71883fe3d5bf7732c83ca8c186c3b4a49c0c8875f8324a74298073f1" exitCode=0
Jul 23 14:04:00.746680 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:00.746677    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz" event={"ID":"06d35991-154d-4780-a419-34cc7a4354d7","Type":"ContainerDied","Data":"377a6b2d71883fe3d5bf7732c83ca8c186c3b4a49c0c8875f8324a74298073f1"}
Jul 23 14:04:00.747007 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:00.746711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz" event={"ID":"06d35991-154d-4780-a419-34cc7a4354d7","Type":"ContainerStarted","Data":"65581026ca6677d51940d067f87e21e85f7eedb56dbb7471b10c62029725f817"}
Jul 23 14:04:01.887184 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:01.887158    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:04:02.074282 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:02.074190    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d35991-154d-4780-a419-34cc7a4354d7-maas-api-service-ca\") pod \"06d35991-154d-4780-a419-34cc7a4354d7\" (UID: \"06d35991-154d-4780-a419-34cc7a4354d7\") "
Jul 23 14:04:02.074520 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:02.074498    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06d35991-154d-4780-a419-34cc7a4354d7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06d35991-154d-4780-a419-34cc7a4354d7" (UID: "06d35991-154d-4780-a419-34cc7a4354d7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 14:04:02.175601 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:02.175564    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06d35991-154d-4780-a419-34cc7a4354d7-maas-api-service-ca\") on node \"ip-10-0-141-235.ec2.internal\" DevicePath \"\""
Jul 23 14:04:02.757858 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:02.757826    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz" event={"ID":"06d35991-154d-4780-a419-34cc7a4354d7","Type":"ContainerDied","Data":"65581026ca6677d51940d067f87e21e85f7eedb56dbb7471b10c62029725f817"}
Jul 23 14:04:02.758015 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:02.757873    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65581026ca6677d51940d067f87e21e85f7eedb56dbb7471b10c62029725f817"
Jul 23 14:04:02.758015 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:02.757836    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"
Jul 23 14:04:09.847317 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:09.847292    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"]
Jul 23 14:04:09.850634 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:09.850608    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-3b0b7b-29746920-dzfk2"]
Jul 23 14:04:10.818106 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:10.818068    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b9c242f-8adf-49e4-ab6f-d89602d6b2a0" path="/var/lib/kubelet/pods/9b9c242f-8adf-49e4-ab6f-d89602d6b2a0/volumes"
Jul 23 14:04:12.511056 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:12.511026    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-dqd8n"]
Jul 23 14:04:14.394470 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:14.394434    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"]
Jul 23 14:04:14.397778 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:14.397755    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-3b0b7b-tbkdz"]
Jul 23 14:04:14.817992 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:14.817924    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06d35991-154d-4780-a419-34cc7a4354d7" path="/var/lib/kubelet/pods/06d35991-154d-4780-a419-34cc7a4354d7/volumes"
Jul 23 14:04:21.828942 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:21.828910    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f58c6bc67-6b6zz_775821b2-3a54-47ee-b363-58a48ebd9ace/authorino/0.log"
Jul 23 14:04:28.313379 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:28.313351    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694f99b88-dfg2g_db10710a-18bc-4d35-94f2-072bb7cd4430/copy-manifests/0.log"
Jul 23 14:04:28.321212 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:28.321185    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694f99b88-dfg2g_db10710a-18bc-4d35-94f2-072bb7cd4430/manager/0.log"
Jul 23 14:04:29.230588 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:29.230560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746905-kcw7t_7368f280-2805-475c-9a0d-2fced95bc3ae/cleanup/0.log"
Jul 23 14:04:29.347066 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:29.347044    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29746920-ntl9q_38b4216e-7738-4ba9-b492-9848339ad769/cleanup/0.log"
Jul 23 14:04:30.877257 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:30.877229    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f58c6bc67-6b6zz_775821b2-3a54-47ee-b363-58a48ebd9ace/authorino/0.log"
Jul 23 14:04:31.626489 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:31.626463    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dqd8n_192cda73-698f-481a-bce5-71659c29041e/limitador/0.log"
Jul 23 14:04:32.396561 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:32.396533    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b4c49cfd-klp2h_c3d6c359-5e28-4fb3-969d-56a6f3567531/kube-auth-proxy/0.log"
Jul 23 14:04:33.021794 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:33.021755    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6497b8bfb-mvn8k_d68280eb-f909-4ac6-83f1-4226ded01c05/router/0.log"
Jul 23 14:04:39.841732 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.841701    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vk9w9/must-gather-qmmjx"]
Jul 23 14:04:39.842076 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.842069    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06d35991-154d-4780-a419-34cc7a4354d7" containerName="revoke-keys"
Jul 23 14:04:39.842142 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.842079    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06d35991-154d-4780-a419-34cc7a4354d7" containerName="revoke-keys"
Jul 23 14:04:39.842189 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.842178    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06d35991-154d-4780-a419-34cc7a4354d7" containerName="revoke-keys"
Jul 23 14:04:39.846743 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.846721    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:39.852049 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.852030    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vk9w9\"/\"default-dockercfg-6vdmn\""
Jul 23 14:04:39.852562 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.852536    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vk9w9\"/\"openshift-service-ca.crt\""
Jul 23 14:04:39.853123 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.852801    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vk9w9\"/\"kube-root-ca.crt\""
Jul 23 14:04:39.906765 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.906736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vk9w9/must-gather-qmmjx"]
Jul 23 14:04:39.940465 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.940436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74149a3a-6c2d-4345-9170-9072d01209fa-must-gather-output\") pod \"must-gather-qmmjx\" (UID: \"74149a3a-6c2d-4345-9170-9072d01209fa\") " pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:39.940589 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:39.940570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p4kq\" (UniqueName: \"kubernetes.io/projected/74149a3a-6c2d-4345-9170-9072d01209fa-kube-api-access-5p4kq\") pod \"must-gather-qmmjx\" (UID: \"74149a3a-6c2d-4345-9170-9072d01209fa\") " pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:40.040910 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.040886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74149a3a-6c2d-4345-9170-9072d01209fa-must-gather-output\") pod \"must-gather-qmmjx\" (UID: \"74149a3a-6c2d-4345-9170-9072d01209fa\") " pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:40.041011 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.040921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p4kq\" (UniqueName: \"kubernetes.io/projected/74149a3a-6c2d-4345-9170-9072d01209fa-kube-api-access-5p4kq\") pod \"must-gather-qmmjx\" (UID: \"74149a3a-6c2d-4345-9170-9072d01209fa\") " pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:40.041256 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.041239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/74149a3a-6c2d-4345-9170-9072d01209fa-must-gather-output\") pod \"must-gather-qmmjx\" (UID: \"74149a3a-6c2d-4345-9170-9072d01209fa\") " pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:40.060777 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.060750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p4kq\" (UniqueName: \"kubernetes.io/projected/74149a3a-6c2d-4345-9170-9072d01209fa-kube-api-access-5p4kq\") pod \"must-gather-qmmjx\" (UID: \"74149a3a-6c2d-4345-9170-9072d01209fa\") " pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:40.155016 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.154991    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vk9w9/must-gather-qmmjx"
Jul 23 14:04:40.288624 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.288597    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vk9w9/must-gather-qmmjx"]
Jul 23 14:04:40.289845 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:04:40.289823    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74149a3a_6c2d_4345_9170_9072d01209fa.slice/crio-ca08dc354a4a589eae6ad35b6549bcfb6120ba292810381ca9e48e993e7bb0aa WatchSource:0}: Error finding container ca08dc354a4a589eae6ad35b6549bcfb6120ba292810381ca9e48e993e7bb0aa: Status 404 returned error can't find the container with id ca08dc354a4a589eae6ad35b6549bcfb6120ba292810381ca9e48e993e7bb0aa
Jul 23 14:04:40.946663 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:40.946634    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vk9w9/must-gather-qmmjx" event={"ID":"74149a3a-6c2d-4345-9170-9072d01209fa","Type":"ContainerStarted","Data":"ca08dc354a4a589eae6ad35b6549bcfb6120ba292810381ca9e48e993e7bb0aa"}
Jul 23 14:04:41.956622 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:41.956584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vk9w9/must-gather-qmmjx" event={"ID":"74149a3a-6c2d-4345-9170-9072d01209fa","Type":"ContainerStarted","Data":"6818c7e3fe7d567ed595b2ef133f2bddb6f5e285563e0b37b23d045bbb825dad"}
Jul 23 14:04:41.957179 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:41.957153    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vk9w9/must-gather-qmmjx" event={"ID":"74149a3a-6c2d-4345-9170-9072d01209fa","Type":"ContainerStarted","Data":"047b76f843c378480d7769b5ee55d9c4f6ab3babd33ca14a13d3a79ad5a12b93"}
Jul 23 14:04:41.980784 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:41.980730    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vk9w9/must-gather-qmmjx" podStartSLOduration=2.07773445 podStartE2EDuration="2.98070947s" totalImagesPullingTime="902.97502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 14:04:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:04:41.978498218 +0000 UTC m=+2825.651363659" watchObservedRunningTime="2026-07-23 14:04:41.98070947 +0000 UTC m=+2825.653574910"
Jul 23 14:04:42.893739 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:42.893705    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hjt2v_7c202944-4918-447e-b505-4bb6ffb66ac6/global-pull-secret-syncer/0.log"
Jul 23 14:04:43.119595 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:43.119557    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vxb2v_c0a03f86-7ad0-4bdf-843e-e450f1580dac/konnectivity-agent/0.log"
Jul 23 14:04:43.196108 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:43.195990    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-235.ec2.internal_77cabb2dc4c03ac54c6bc0b67bc8bb5e/haproxy/0.log"
Jul 23 14:04:48.474572 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:48.474509    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f58c6bc67-6b6zz_775821b2-3a54-47ee-b363-58a48ebd9ace/authorino/0.log"
Jul 23 14:04:48.769741 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:48.769623    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-dqd8n_192cda73-698f-481a-bce5-71659c29041e/limitador/0.log"
Jul 23 14:04:50.964157 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:50.963352    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-w2fdv_cd515e9d-3675-4b1b-b5ba-d952156e835f/cluster-monitoring-operator/0.log"
Jul 23 14:04:50.990515 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:50.990478    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-sr5bw_c9ca1b46-f389-4385-9468-5b703a0042bb/kube-state-metrics/0.log"
Jul 23 14:04:51.015122 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.015074    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-sr5bw_c9ca1b46-f389-4385-9468-5b703a0042bb/kube-rbac-proxy-main/0.log"
Jul 23 14:04:51.042904 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.042878    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-sr5bw_c9ca1b46-f389-4385-9468-5b703a0042bb/kube-rbac-proxy-self/0.log"
Jul 23 14:04:51.073599 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.073560    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7667b4dc47-45d4n_bb5e1f14-8e26-4ca7-8d80-0b09a0cb8933/metrics-server/0.log"
Jul 23 14:04:51.102936 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.102911    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-m5m7n_8bb7c619-0a33-4eb2-8b52-7b2f55dfc5a8/monitoring-plugin/0.log"
Jul 23 14:04:51.295926 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.295834    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxdx_a7503433-f2c4-43a0-a126-c08476fc9190/node-exporter/0.log"
Jul 23 14:04:51.360077 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.360052    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxdx_a7503433-f2c4-43a0-a126-c08476fc9190/kube-rbac-proxy/0.log"
Jul 23 14:04:51.416858 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.416832    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcxdx_a7503433-f2c4-43a0-a126-c08476fc9190/init-textfile/0.log"
Jul 23 14:04:51.554678 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.554566    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gg67q_100feeaf-6229-47d5-8217-56755f476427/kube-rbac-proxy-main/0.log"
Jul 23 14:04:51.579250 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.579219    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gg67q_100feeaf-6229-47d5-8217-56755f476427/kube-rbac-proxy-self/0.log"
Jul 23 14:04:51.609991 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.609959    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-gg67q_100feeaf-6229-47d5-8217-56755f476427/openshift-state-metrics/0.log"
Jul 23 14:04:51.647248 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.647216    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/prometheus/0.log"
Jul 23 14:04:51.676152 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.676121    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/config-reloader/0.log"
Jul 23 14:04:51.704463 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.704432    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/thanos-sidecar/0.log"
Jul 23 14:04:51.739995 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.739963    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/kube-rbac-proxy-web/0.log"
Jul 23 14:04:51.768894 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.768870    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/kube-rbac-proxy/0.log"
Jul 23 14:04:51.795075 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.795048    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/kube-rbac-proxy-thanos/0.log"
Jul 23 14:04:51.822492 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.822426    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a1a66800-7f27-46b1-82af-13f941b15c99/init-config-reloader/0.log"
Jul 23 14:04:51.859762 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.859731    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5x296_e4371828-48c3-4378-952b-3c31f92a7c3e/prometheus-operator/0.log"
Jul 23 14:04:51.886273 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.886240    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-5x296_e4371828-48c3-4378-952b-3c31f92a7c3e/kube-rbac-proxy/0.log"
Jul 23 14:04:51.917141 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:51.917109    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-7kj9w_4861894d-b3d4-499b-8668-5319459f5a01/prometheus-operator-admission-webhook/0.log"
Jul 23 14:04:52.093440 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.093362    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d6cb86c9-cgwf5_278ee5c2-ad41-45d7-86bd-262c12d42aac/thanos-query/0.log"
Jul 23 14:04:52.108579 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.108542    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"]
Jul 23 14:04:52.112713 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.112690    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.122907 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.122871    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"]
Jul 23 14:04:52.133210 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.133181    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d6cb86c9-cgwf5_278ee5c2-ad41-45d7-86bd-262c12d42aac/kube-rbac-proxy-web/0.log"
Jul 23 14:04:52.156447 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.156422    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d6cb86c9-cgwf5_278ee5c2-ad41-45d7-86bd-262c12d42aac/kube-rbac-proxy/0.log"
Jul 23 14:04:52.183967 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.183940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d6cb86c9-cgwf5_278ee5c2-ad41-45d7-86bd-262c12d42aac/prom-label-proxy/0.log"
Jul 23 14:04:52.218213 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.218191    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d6cb86c9-cgwf5_278ee5c2-ad41-45d7-86bd-262c12d42aac/kube-rbac-proxy-rules/0.log"
Jul 23 14:04:52.238966 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.238940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-85d6cb86c9-cgwf5_278ee5c2-ad41-45d7-86bd-262c12d42aac/kube-rbac-proxy-metrics/0.log"
Jul 23 14:04:52.280437 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.280400    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-sys\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.280637 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.280507    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-lib-modules\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.280637 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.280586    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-proc\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.280637 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.280632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g4zf\" (UniqueName: \"kubernetes.io/projected/7aab21c6-8316-4600-91bd-2057481c7f31-kube-api-access-4g4zf\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.280821 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.280673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-podres\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.381667 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-sys\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.381874 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-lib-modules\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.381874 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-proc\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.381874 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-sys\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.381874 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g4zf\" (UniqueName: \"kubernetes.io/projected/7aab21c6-8316-4600-91bd-2057481c7f31-kube-api-access-4g4zf\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.382122 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-podres\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.382122 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381946    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-lib-modules\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.382122 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.381854    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-proc\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.382122 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.382034    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7aab21c6-8316-4600-91bd-2057481c7f31-podres\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.390908 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.390884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g4zf\" (UniqueName: \"kubernetes.io/projected/7aab21c6-8316-4600-91bd-2057481c7f31-kube-api-access-4g4zf\") pod \"perf-node-gather-daemonset-lw6xt\" (UID: \"7aab21c6-8316-4600-91bd-2057481c7f31\") " pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.426236 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.426203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:52.592459 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:52.591947    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"]
Jul 23 14:04:52.598226 ip-10-0-141-235 kubenswrapper[2581]: W0723 14:04:52.598199    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7aab21c6_8316_4600_91bd_2057481c7f31.slice/crio-f9f1926911d84765c775b7e991db591f57d60e848957e00d3b86523339a6898b WatchSource:0}: Error finding container f9f1926911d84765c775b7e991db591f57d60e848957e00d3b86523339a6898b: Status 404 returned error can't find the container with id f9f1926911d84765c775b7e991db591f57d60e848957e00d3b86523339a6898b
Jul 23 14:04:53.068014 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.067928    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt" event={"ID":"7aab21c6-8316-4600-91bd-2057481c7f31","Type":"ContainerStarted","Data":"9a908834135c75503eb83c96ab7856d1c0b54b08b0b697f89cf54fa519134805"}
Jul 23 14:04:53.068326 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.068259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt" event={"ID":"7aab21c6-8316-4600-91bd-2057481c7f31","Type":"ContainerStarted","Data":"f9f1926911d84765c775b7e991db591f57d60e848957e00d3b86523339a6898b"}
Jul 23 14:04:53.068326 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.068298    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:53.088923 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.088854    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt" podStartSLOduration=1.088833483 podStartE2EDuration="1.088833483s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 14:04:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 14:04:53.085998535 +0000 UTC m=+2836.758863978" watchObservedRunningTime="2026-07-23 14:04:53.088833483 +0000 UTC m=+2836.761698927"
Jul 23 14:04:53.371106 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.371059    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-nrx2w_f39f9671-1363-415c-ae2e-3be33b5c2fef/networking-console-plugin/0.log"
Jul 23 14:04:53.883310 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.883276    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/1.log"
Jul 23 14:04:53.890037 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:53.890013    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-67r7j_29ad2808-523c-4f70-b446-61fd56da3bdd/console-operator/2.log"
Jul 23 14:04:54.360246 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:54.360162    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-hzmmj_72d23988-f810-49a8-8870-c3860712d771/download-server/0.log"
Jul 23 14:04:54.963841 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:54.963807    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-2jb9r_38084d51-2f23-432a-a2b1-b5b1f0052f95/volume-data-source-validator/0.log"
Jul 23 14:04:56.085920 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:56.085892    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hj9rr_4d9aea88-b36a-4bd5-81ec-542b5a642c6b/dns/0.log"
Jul 23 14:04:56.121163 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:56.121127    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hj9rr_4d9aea88-b36a-4bd5-81ec-542b5a642c6b/kube-rbac-proxy/0.log"
Jul 23 14:04:56.283918 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:56.283888    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x8p5f_8baab27e-7c43-4f63-9b8a-b289a0727d62/dns-node-resolver/0.log"
Jul 23 14:04:57.001587 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:57.001558    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r7tsz_27b8ae6a-bf71-44c1-a92c-e7ddc36d0496/node-ca/0.log"
Jul 23 14:04:58.122628 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:58.122596    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b4c49cfd-klp2h_c3d6c359-5e28-4fb3-969d-56a6f3567531/kube-auth-proxy/0.log"
Jul 23 14:04:58.291393 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:58.291365    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6497b8bfb-mvn8k_d68280eb-f909-4ac6-83f1-4226ded01c05/router/0.log"
Jul 23 14:04:59.008002 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.007940    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lp8gs_0270273c-d91f-4785-8293-e2c593a1219c/serve-healthcheck-canary/0.log"
Jul 23 14:04:59.089673 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.089645    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vk9w9/perf-node-gather-daemonset-lw6xt"
Jul 23 14:04:59.465675 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.465643    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-szjfl_0fa6d26a-1db4-42d8-8d3f-85698faa9e1e/insights-operator/0.log"
Jul 23 14:04:59.467226 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.467202    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-szjfl_0fa6d26a-1db4-42d8-8d3f-85698faa9e1e/insights-operator/1.log"
Jul 23 14:04:59.491896 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.491861    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9rssb_56ce1c97-cbff-49a6-aaa9-273612cdf216/kube-rbac-proxy/0.log"
Jul 23 14:04:59.513725 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.513702    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9rssb_56ce1c97-cbff-49a6-aaa9-273612cdf216/exporter/0.log"
Jul 23 14:04:59.537974 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:04:59.537937    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9rssb_56ce1c97-cbff-49a6-aaa9-273612cdf216/extractor/0.log"
Jul 23 14:05:02.563360 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:02.563326    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694f99b88-dfg2g_db10710a-18bc-4d35-94f2-072bb7cd4430/manager/0.log"
Jul 23 14:05:02.585397 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:02.585375    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-694f99b88-dfg2g_db10710a-18bc-4d35-94f2-072bb7cd4430/copy-manifests/0.log"
Jul 23 14:05:02.814331 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:02.814256    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b4c49cfd-klp2h_c3d6c359-5e28-4fb3-969d-56a6f3567531/kube-auth-proxy/0.log"
Jul 23 14:05:02.943482 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:02.943451    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6497b8bfb-mvn8k_d68280eb-f909-4ac6-83f1-4226ded01c05/router/0.log"
Jul 23 14:05:04.104779 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:04.104744    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8d7f7f5f-mv42b_e27e5b22-19b1-4de4-89dc-bcf5b1d3b9d5/manager/0.log"
Jul 23 14:05:04.235288 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:04.235221    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75b4c49cfd-klp2h_c3d6c359-5e28-4fb3-969d-56a6f3567531/kube-auth-proxy/0.log"
Jul 23 14:05:04.376230 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:04.376202    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6497b8bfb-mvn8k_d68280eb-f909-4ac6-83f1-4226ded01c05/router/0.log"
Jul 23 14:05:08.829625 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:08.829551    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-b475p_18e8232e-5e5b-47d2-9c68-509ae88cf59d/migrator/0.log"
Jul 23 14:05:08.849832 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:08.849807    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-b475p_18e8232e-5e5b-47d2-9c68-509ae88cf59d/graceful-termination/0.log"
Jul 23 14:05:09.277351 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:09.277323    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9tvch_e8395b87-111d-466e-b079-de2d532879f4/kube-storage-version-migrator-operator/1.log"
Jul 23 14:05:09.279165 ip-10-0-141-235 kubenswrapper[2581]: I0723 14:05:09.279137    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-9tvch_e8395b87-111d-466e-b079-de2d532879f4/kube-storage-version-migrator-operator/0.log"