Jul 16 17:26:56.286302 ip-10-0-134-187 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 17:26:56.286314 ip-10-0-134-187 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 17:26:56.286323 ip-10-0-134-187 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 17:26:56.286824 ip-10-0-134-187 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 17:27:07.470424 ip-10-0-134-187 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 17:27:07.470442 ip-10-0-134-187 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3085f182ca4f41f2b82d854cdc595c0a --
Jul 16 17:28:40.325599 ip-10-0-134-187 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.805757    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810816    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810828    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810832    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810835    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810838    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810843    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810847    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:28:40.820651 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810850    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810853    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810858    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810862    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810864    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810873    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810876    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810879    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810881    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810885    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810887    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810890    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810893    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810896    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810898    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810901    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810904    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810907    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810909    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810913    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:28:40.823240 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810915    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810918    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810920    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810923    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810925    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810928    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810930    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810933    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810936    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810939    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810942    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810944    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810948    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810950    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810953    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810956    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810958    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810961    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810964    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:28:40.824623 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810966    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810969    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810972    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810975    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810977    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810980    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810982    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810985    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810988    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810991    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810993    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810996    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.810998    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811001    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811003    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811006    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811009    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811012    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811014    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811017    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:28:40.840933 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811019    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811022    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811025    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811027    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811032    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811035    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811037    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811040    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811043    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811046    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811049    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811051    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811054    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811057    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811060    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811062    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811065    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811068    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811072    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:28:40.844227 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811076    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811079    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811082    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811085    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811088    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811090    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811093    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811096    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811099    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811102    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811104    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811107    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811109    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.811112    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813234    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813245    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813249    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813252    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813255    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813259    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:28:40.857655 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813261    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813264    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813266    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813269    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813272    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813275    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813278    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813280    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813283    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813286    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813288    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813291    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813294    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813296    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813299    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813301    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813304    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813306    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813309    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813312    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:28:41.113837 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813315    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813317    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813320    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813323    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813342    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813345    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813355    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813358    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813360    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813363    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813366    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813368    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813371    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813373    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813376    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813378    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813381    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813383    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813386    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813389    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:28:41.132079 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813391    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:28:40.887093 ip-10-0-134-187 systemd[1]: Started Kubernetes Kubelet.
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813394    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813396    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813399    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813402    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813404    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813407    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813409    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813414    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813417    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813420    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813423    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813426    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813429    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813434    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813438    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813441    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813444    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813447    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:28:41.149210 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813451    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813453    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813456    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813460    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813462    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813465    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813468    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813471    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813474    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813476    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813479    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813482    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813485    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813487    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813495    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813498    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813500    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813503    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813506    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813509    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:28:41.149958 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813511    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813515    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813518    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813521    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813523    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813526    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813528    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813531    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813534    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813537    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813541    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813544    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813547    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813551    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813942    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813947    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813951    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813954    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813957    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:28:41.150762 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813960    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813962    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813965    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813968    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813970    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813973    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813975    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813978    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813981    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813984    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813986    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.813990    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814008    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814012    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814016    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814019    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814022    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814025    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814028    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814031    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:28:41.151595 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814033    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814036    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814038    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814042    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814046    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814048    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814051    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814053    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814056    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814059    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814063    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814066    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814070    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814074    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814077    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814079    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814082    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814084    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814087    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:28:41.152189 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814089    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814092    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814094    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814097    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814100    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814103    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814106    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814110    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814112    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814115    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814118    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814120    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814123    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814125    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814128    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814130    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814133    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814136    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814138    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814141    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:28:41.152818 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814143    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814146    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814148    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814151    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814153    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814156    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814159    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814162    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814164    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814167    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814170    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814172    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814175    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814177    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814180    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814182    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814185    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814189    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814194    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814198    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:28:41.153445 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814201    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814204    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814206    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814209    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814212    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814214    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814217    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814219    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814222    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814225    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814227    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814230    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814232    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814235    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814237    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814302    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814309    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814315    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814320    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814341    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814345    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814357    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 17:28:41.154060 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814363    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814366    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814369    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814372    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814376    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814379    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814382    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814384    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814387    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814392    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814396    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814400    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814403    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814406    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814409    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814412    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814416    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814418    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814421    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814425    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814428    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814430    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814433    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814436    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 17:28:41.154708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814439    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814443    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814446    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814448    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814452    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814455    2577 flags.go:64] FLAG: --enable-server="true"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814458    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814462    2577 flags.go:64] FLAG: --event-burst="100"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814465    2577 flags.go:64] FLAG: --event-qps="50"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814468    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814471    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814474    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814478    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814481    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814483    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814486    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814489    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814493    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814496    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814499    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814502    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814505    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814508    2577 flags.go:64] FLAG: --feature-gates=""
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814512    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814515    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 17:28:41.155504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814518    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814520    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814524    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814526    2577 flags.go:64] FLAG: --help="false"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814529    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814532    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814535    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814538    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814542    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814545    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814547    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814551    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814554    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814557    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814560    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814563    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814565    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814568    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814571    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814574    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814577    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814580    2577 flags.go:64] FLAG: --lock-file=""
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814582    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814585    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 17:28:41.156373 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814589    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814594    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814598    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814601    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814604    2577 flags.go:64] FLAG: --logging-format="text"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814606    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814610    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814612    2577 flags.go:64] FLAG: --manifest-url=""
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814615    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814619    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814622    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814626    2577 flags.go:64] FLAG: --max-pods="110"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814629    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814632    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814634    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814637    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814640    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814643    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814646    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814655    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814658    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814661    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814664    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 16 17:28:41.157198 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814666    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814672    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814675    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814677    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814680    2577 flags.go:64] FLAG: --port="10250"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814683    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814686    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0461e11ef472c2ca6"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814690    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814692    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814695    2577 flags.go:64] FLAG: --register-node="true"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814699    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814703    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814707    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814710    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814712    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814716    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814719    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814722    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814725    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814727    2577 flags.go:64] FLAG: --runonce="false"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814730    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814733    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814736    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814739    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814742    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814745    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 17:28:41.158039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814748    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814751    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814755    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814758    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814761    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814764    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814767    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814770    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814773    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814778    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814780    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814783    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814787    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814790    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814793    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814796    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814799    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814803    2577 flags.go:64] FLAG: --v="2"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814806    2577 flags.go:64] FLAG: --version="false"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814811    2577 flags.go:64] FLAG: --vmodule=""
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814814    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.814817    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814931    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814934    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:28:41.159053 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814937    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814941    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814945    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814949    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814952    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814955    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814958    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814961    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814964    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814967    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814971    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814974    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814976    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814979    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814982    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814985    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814987    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814990    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814992    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:28:41.159820 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814995    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.814997    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815000    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815002    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815005    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815009    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815011    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815014    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815016    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815019    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815022    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815024    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815027    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815030    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815032    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815035    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815037    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815040    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815042    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815045    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:28:41.160442 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815048    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815050    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815053    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815057    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815059    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815062    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815065    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815067    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815070    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815072    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815075    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815077    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815080    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815083    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815085    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815089    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815092    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815097    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815099    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815102    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:28:41.160974 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815105    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815107    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815114    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815117    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815120    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815122    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815125    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815127    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815130    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815133    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815135    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815137    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815140    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815142    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815145    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815149    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815151    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815154    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815157    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:28:41.161558 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815160    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815162    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815165    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815167    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815170    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815172    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815175    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815177    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815180    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815182    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815187    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815190    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815192    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815195    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815198    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815201    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815205    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815209    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:28:41.162072 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.815212    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.815974    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.825202    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.825221    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.826143    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.826153    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826229    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826237    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826242    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826246    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826251    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826255    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826259    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826263    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:28:41.162650 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826267    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826272    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826276    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826279    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826283    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826288    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826292    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826296    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826300    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826303    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826308    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826311    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826317    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826323    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826340    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826345    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826350    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826354    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826359    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826362    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:28:41.312246 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826366    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826372    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826379    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826383    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826387    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826391    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826395    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826399    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826404    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826410    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826414    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826418    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826422    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826426    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826430    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826433    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826437    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826441    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826445    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826449    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:28:41.312903 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826453    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826457    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826461    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826466    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826470    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826473    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826476    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826479    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826482    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826484    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826487    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826490    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826493    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826496    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826500    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826503    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826506    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826510    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826513    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:28:41.314168 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826515    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826518    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826521    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826525    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826528    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826532    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826536    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826540    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826544    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826548    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826552    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826556    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826559    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826563    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826567    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826571    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826575    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826579    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826583    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826587    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:28:41.314714 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826591    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826594    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826598    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826601    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826606    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826610    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826614    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826619    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826624    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826628    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826632    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826636    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.826644    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826797    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826803    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:28:41.315230 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826807    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826812    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826816    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826821    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826826    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826830    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826834    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826838    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826841    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826845    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826849    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826854    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826857    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826861    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826865    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826869    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826873    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826877    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826880    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826885    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:28:41.315691 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826889    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826892    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826897    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826900    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826904    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826910    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826915    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826918    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826922    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826926    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826930    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826934    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826938    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826941    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826945    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826950    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826955    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826959    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826963    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826967    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:28:41.316233 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826972    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826976    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826980    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826984    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826987    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826991    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826995    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.826999    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827002    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827006    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827010    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827014    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827018    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827021    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827025    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827029    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827033    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827038    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827044    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:28:41.316831 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827051    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827056    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827060    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827064    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827068    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827072    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827076    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827080    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827084    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827088    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827091    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827095    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827098    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827102    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827105    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827109    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827113    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827117    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827121    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:28:41.317348 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827124    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827128    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827132    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827136    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827140    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827143    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827147    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827151    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827154    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827158    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827161    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827166    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827170    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827175    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827180    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827184    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827188    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827193    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:28:41.437827 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:40.827198    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.827205    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.827352    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.829749    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.831469    2577 server.go:1019] "Starting client certificate rotation"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.831564    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.831593    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.835107    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.840978    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.849678    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.852671    2577 log.go:25] "Validated CRI v1 image API"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.853403    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 17:28:41.439028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.859689    2577 fs.go:135] Filesystem UUIDs: map[22b2a6e6-33d6-444a-bb4b-bc56f7d391bf:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 baf62c30-c5d8-48e6-85b6-891552dc14ce:/dev/nvme0n1p4]
Jul 16 17:28:41.439456 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.859705    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.864700    2577 manager.go:216] Machine: {Timestamp:2026-07-16 17:28:40.863345002 +0000 UTC m=+0.379942912 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093240 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec290ce297394540ff81b55eb3262c92 SystemUUID:ec290ce2-9739-4540-ff81-b55eb3262c92 BootID:3085f182-ca4f-41f2-b82d-854cdc595c0a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:98:5a:95:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:98:5a:95:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:d6:11:e4:3d:55 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.864799    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.864905    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.867622    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.868340    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.868363    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 17:28:41.439528 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.869208    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.869218    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.869226    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.869239    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.870477    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875102    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875218    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875243    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875252    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875279    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875291    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875305    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875588    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.875602    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.878025    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.879713    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.879740    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880455    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880468    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880474    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880479    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880487    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880493    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880543    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880549    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880555    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880561    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880575    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.880582    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.881437    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.881443    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.884456    2577 server.go:1268] "Started kubelet"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.884541    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.884545    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.884619    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.886918    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.888784    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.891053    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.892966    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 17:28:41.439823 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.893000    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.893028    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.893292    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-187.ec2.internal.18c2d54b176d2b11  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-187.ec2.internal,UID:ip-10-0-134-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-187.ec2.internal,},FirstTimestamp:2026-07-16 17:28:40.884431633 +0000 UTC m=+0.401029543,LastTimestamp:2026-07-16 17:28:40.884431633 +0000 UTC m=+0.401029543,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-187.ec2.internal,}"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.896465    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.896488    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.896542    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897171    2577 factory.go:55] Registering systemd factory
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897204    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897264    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897279    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897263    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897396    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897406    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897399    2577 factory.go:153] Registering CRI-O factory
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897428    2577 factory.go:223] Registration of the crio container factory successfully
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897501    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897520    2577 factory.go:103] Registering Raw factory
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897531    2577 manager.go:1196] Started watching for new ooms in manager
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.897838    2577 manager.go:349] Starting recovery of all containers
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.907475    2577 manager.go:354] Recovery completed
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.909140    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.909186    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.913124    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916308    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916362    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916375    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916855    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916864    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916865    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.916925    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.917565    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.440867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.917590    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.917599    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.918606    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-187.ec2.internal.18c2d54b1954211d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-187.ec2.internal,UID:ip-10-0-134-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-187.ec2.internal,},FirstTimestamp:2026-07-16 17:28:40.916345117 +0000 UTC m=+0.432943029,LastTimestamp:2026-07-16 17:28:40.916345117 +0000 UTC m=+0.432943029,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-187.ec2.internal,}"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.919106    2577 policy_none.go:49] "None policy: Start"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.919119    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.919129    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.921121    2577 policy_none.go:47] "Start"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.932560    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-187.ec2.internal.18c2d54b195479a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-187.ec2.internal,UID:ip-10-0-134-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-187.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-187.ec2.internal,},FirstTimestamp:2026-07-16 17:28:40.916367783 +0000 UTC m=+0.432965692,LastTimestamp:2026-07-16 17:28:40.916367783 +0000 UTC m=+0.432965692,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-187.ec2.internal,}"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.944614    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-187.ec2.internal.18c2d54b1954ae4c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-187.ec2.internal,UID:ip-10-0-134-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-187.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-187.ec2.internal,},FirstTimestamp:2026-07-16 17:28:40.91638126 +0000 UTC m=+0.432979169,LastTimestamp:2026-07-16 17:28:40.91638126 +0000 UTC m=+0.432979169,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-187.ec2.internal,}"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.953298    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bkxfp"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.964781    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-187.ec2.internal.18c2d54b1954211d\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-187.ec2.internal.18c2d54b1954211d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-187.ec2.internal,UID:ip-10-0-134-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-187.ec2.internal,},FirstTimestamp:2026-07-16 17:28:40.916345117 +0000 UTC m=+0.432943029,LastTimestamp:2026-07-16 17:28:40.917576651 +0000 UTC m=+0.434174560,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-187.ec2.internal,}"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.965263    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bkxfp"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.975072    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 17:28:41.441800 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.976229    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.976261    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.976283    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.976321    2577 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977012    2577 manager.go:337] "Starting Device Plugin manager"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.977043    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977054    2577 server.go:87] "Starting device plugin registration server"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977316    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977345    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977522    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977592    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.977600    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.978193    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:40.978256    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:40.979521    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.077174    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"]
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.077236    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.077561    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078200    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078231    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078247    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078268    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078686    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078710    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.078719    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.080802    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.080901    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.080925    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.081492    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.081513    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.081514    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.081524    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.081535    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.081544    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.083572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.442197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.083599    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.084235    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.084253    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.084261    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.088963    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.088977    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-187.ec2.internal\": node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.102886    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-187.ec2.internal\" not found" node="ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.106963    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-187.ec2.internal\" not found" node="ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.127421    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.198501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3369db8d39a147bcbc981aaa29066b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal\" (UID: \"3369db8d39a147bcbc981aaa29066b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.198524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3369db8d39a147bcbc981aaa29066b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal\" (UID: \"3369db8d39a147bcbc981aaa29066b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.198540    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43acf0dee4ffc0ab3e3423a5eeb01c65-config\") pod \"kube-apiserver-proxy-ip-10-0-134-187.ec2.internal\" (UID: \"43acf0dee4ffc0ab3e3423a5eeb01c65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.228219    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.298874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3369db8d39a147bcbc981aaa29066b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal\" (UID: \"3369db8d39a147bcbc981aaa29066b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.298830    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3369db8d39a147bcbc981aaa29066b97-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal\" (UID: \"3369db8d39a147bcbc981aaa29066b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.298932    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3369db8d39a147bcbc981aaa29066b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal\" (UID: \"3369db8d39a147bcbc981aaa29066b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.298956    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43acf0dee4ffc0ab3e3423a5eeb01c65-config\") pod \"kube-apiserver-proxy-ip-10-0-134-187.ec2.internal\" (UID: \"43acf0dee4ffc0ab3e3423a5eeb01c65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.298990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43acf0dee4ffc0ab3e3423a5eeb01c65-config\") pod \"kube-apiserver-proxy-ip-10-0-134-187.ec2.internal\" (UID: \"43acf0dee4ffc0ab3e3423a5eeb01c65\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443217 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.299019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3369db8d39a147bcbc981aaa29066b97-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal\" (UID: \"3369db8d39a147bcbc981aaa29066b97\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443741 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.328632    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.443741 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.406974    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443741 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.410629    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.443741 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.429077    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.573775 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.529633    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.721885 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.630148    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.866043 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.730878    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.866043 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.831325    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-187.ec2.internal\" not found"
Jul 16 17:28:41.866043 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.831369    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 17:28:41.866043 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.831509    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:28:41.866043 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.862656    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.875838    2577 apiserver.go:52] "Watching apiserver"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.892736    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.893062    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7bzvs","openshift-dns/node-resolver-pl2dk","openshift-image-registry/node-ca-nx2hc","openshift-multus/multus-additional-cni-plugins-jjl9j","openshift-network-diagnostics/network-check-target-vwvlf","openshift-multus/multus-5ddvh","openshift-multus/network-metrics-daemon-vgz4v","openshift-network-operator/iptables-alerter-fwtxk","openshift-ovn-kubernetes/ovnkube-node-fshx8","kube-system/global-pull-secret-syncer-h69s6","kube-system/konnectivity-agent-vdttd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"]
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.897385    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.897415    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-kubernetes\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902746    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-systemd\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-run\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d26e290-106a-401d-8992-a5293ae85021-etc-tuned\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d26e290-106a-401d-8992-a5293ae85021-tmp\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902840    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9br2g\" (UniqueName: \"kubernetes.io/projected/8d26e290-106a-401d-8992-a5293ae85021-kube-api-access-9br2g\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902859    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-modprobe-d\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysctl-conf\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902897    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-host\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysctl-d\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.985726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-var-lib-kubelet\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysconfig\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-sys\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.902987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-lib-modules\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.904613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.906981    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.906985    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2khlh\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.907101    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.907381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.910243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.912079    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.912256    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2g76n\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.912411    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.912687    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6qwfs\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.912856    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.912970    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.913050    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.913141    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.915417    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.915481    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.918755    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.918790    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.918942    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.918967    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hgbkp\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.919094    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.919098    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:28:41.987372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.919212    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.919920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.922946    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6rwrk\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.922974    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.923002    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.923044    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.923204    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.923261    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.925824    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.928255    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.928271    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.928719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.929184    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.928847    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-psw84\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.931342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.932201    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.932771    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.933331    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.933413    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:41.933719    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.933846    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.934440    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b527r\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.934669    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.936087    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.936600    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.939753    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal"]
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.939779    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal"]
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.939847    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.940490    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zrrdn\""
Jul 16 17:28:41.988821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.940610    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.941239    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.942521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.942606    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.942615    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.942623    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xf92h\""
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.959923    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gbnpx"
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.970883    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:23:41 +0000 UTC" deadline="2028-03-02 06:41:24.379139922 +0000 UTC"
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.970913    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14269h12m42.408228962s"
Jul 16 17:28:41.990329 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.975362    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gbnpx"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:41.998384    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-multus-certs\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93b8d26c-2622-42d2-8114-24f24049e3e3-hosts-file\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-socket-dir-parent\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-cni-multus\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-sys\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ftt9\" (UniqueName: \"kubernetes.io/projected/b213759c-39a6-4c31-a70c-3bee0064a026-kube-api-access-2ftt9\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-slash\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-cni-bin\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-registration-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003742    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-sys\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-systemd\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-cnibin\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.088379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-cni-bin\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-kubelet\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-systemd\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003831    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l86kg\" (UniqueName: \"kubernetes.io/projected/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-kube-api-access-l86kg\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003851    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-kubelet\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003865    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-ovn\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-node-log\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-cni-binary-copy\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovnkube-script-lib\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c-konnectivity-ca\") pod \"konnectivity-agent-vdttd\" (UID: \"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c\") " pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.003971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-var-lib-kubelet\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004027    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.089817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-var-lib-kubelet\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-systemd-units\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovn-node-metrics-cert\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysconfig\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-lib-modules\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spqgn\" (UniqueName: \"kubernetes.io/projected/a4d9fc90-1881-4726-ac31-23e07c377c50-kube-api-access-spqgn\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysconfig\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-run-netns\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-lib-modules\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7cwx\" (UniqueName: \"kubernetes.io/projected/93b8d26c-2622-42d2-8114-24f24049e3e3-kube-api-access-t7cwx\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004320    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-socket-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-kubernetes\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9br2g\" (UniqueName: \"kubernetes.io/projected/8d26e290-106a-401d-8992-a5293ae85021-kube-api-access-9br2g\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.090798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-kubernetes\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004410    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b8d26c-2622-42d2-8114-24f24049e3e3-tmp-dir\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-modprobe-d\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysctl-conf\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-log-socket\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-modprobe-d\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06858021-a732-4a5d-963d-2fe4b6a8a696-dbus\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysctl-conf\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysctl-d\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-os-release\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-etc-sysctl-d\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.091774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004835    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-k8s-cni-cncf-io\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-hostroot\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004883    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-daemon-config\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-cni-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgc28\" (UniqueName: \"kubernetes.io/projected/9344c26b-9551-4f9a-8248-00878963f706-kube-api-access-pgc28\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.004993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-systemd\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005075    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwkz7\" (UniqueName: \"kubernetes.io/projected/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-kube-api-access-cwkz7\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw2vw\" (UniqueName: \"kubernetes.io/projected/97129229-9410-4726-a34c-262a5e337122-kube-api-access-bw2vw\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-sys-fs\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-run\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d26e290-106a-401d-8992-a5293ae85021-etc-tuned\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d26e290-106a-401d-8992-a5293ae85021-tmp\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.092733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-os-release\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-etc-kubernetes\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97129229-9410-4726-a34c-262a5e337122-iptables-alerter-script\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-host\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-system-cni-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-conf-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-var-lib-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-etc-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-cni-netd\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97129229-9410-4726-a34c-262a5e337122-host-slash\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005506    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-host\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005520    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06858021-a732-4a5d-963d-2fe4b6a8a696-kubelet-config\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.093488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005603    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kj72\" (UniqueName: \"kubernetes.io/projected/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-kube-api-access-6kj72\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4d9fc90-1881-4726-ac31-23e07c377c50-host\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovnkube-config\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005653    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-netns\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-env-overrides\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c-agent-certs\") pod \"konnectivity-agent-vdttd\" (UID: \"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c\") " pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005731    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-device-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005755    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4d9fc90-1881-4726-ac31-23e07c377c50-serviceca\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-system-cni-dir\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005849    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8d26e290-106a-401d-8992-a5293ae85021-run\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.005861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-cnibin\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.008527    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8d26e290-106a-401d-8992-a5293ae85021-etc-tuned\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.008571    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8d26e290-106a-401d-8992-a5293ae85021-tmp\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.094202 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.028440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9br2g\" (UniqueName: \"kubernetes.io/projected/8d26e290-106a-401d-8992-a5293ae85021-kube-api-access-9br2g\") pod \"tuned-7bzvs\" (UID: \"8d26e290-106a-401d-8992-a5293ae85021\") " pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7cwx\" (UniqueName: \"kubernetes.io/projected/93b8d26c-2622-42d2-8114-24f24049e3e3-kube-api-access-t7cwx\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106503    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-socket-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106634    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-socket-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106670    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b8d26c-2622-42d2-8114-24f24049e3e3-tmp-dir\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-log-socket\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06858021-a732-4a5d-963d-2fe4b6a8a696-dbus\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-run-ovn-kubernetes\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-os-release\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106853    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-log-socket\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06858021-a732-4a5d-963d-2fe4b6a8a696-dbus\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.106921    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:42.168124 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93b8d26c-2622-42d2-8114-24f24049e3e3-tmp-dir\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.106968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-os-release\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.107007    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:42.606984224 +0000 UTC m=+2.123582127 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107058    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-k8s-cni-cncf-io\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-k8s-cni-cncf-io\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107172    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-hostroot\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-hostroot\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107208    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-daemon-config\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-cni-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgc28\" (UniqueName: \"kubernetes.io/projected/9344c26b-9551-4f9a-8248-00878963f706-kube-api-access-pgc28\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-systemd\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.173135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwkz7\" (UniqueName: \"kubernetes.io/projected/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-kube-api-access-cwkz7\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-cni-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107333    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw2vw\" (UniqueName: \"kubernetes.io/projected/97129229-9410-4726-a34c-262a5e337122-kube-api-access-bw2vw\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-systemd\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-sys-fs\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-os-release\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107362    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-etc-kubernetes\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107429    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-sys-fs\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97129229-9410-4726-a34c-262a5e337122-iptables-alerter-script\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-system-cni-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-etc-kubernetes\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-conf-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-var-lib-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107566    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-system-cni-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.174209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-conf-dir\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-etc-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-var-lib-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107654    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-cni-netd\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97129229-9410-4726-a34c-262a5e337122-host-slash\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107625    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-etc-openvswitch\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-cni-netd\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97129229-9410-4726-a34c-262a5e337122-host-slash\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06858021-a732-4a5d-963d-2fe4b6a8a696-kubelet-config\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kj72\" (UniqueName: \"kubernetes.io/projected/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-kube-api-access-6kj72\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4d9fc90-1881-4726-ac31-23e07c377c50-host\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06858021-a732-4a5d-963d-2fe4b6a8a696-kubelet-config\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovnkube-config\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.176054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-netns\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107861    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-env-overrides\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c-agent-certs\") pod \"konnectivity-agent-vdttd\" (UID: \"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c\") " pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-daemon-config\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-netns\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.107989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/97129229-9410-4726-a34c-262a5e337122-iptables-alerter-script\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108029    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-os-release\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a4d9fc90-1881-4726-ac31-23e07c377c50-host\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.108101    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.108202    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:42.608180165 +0000 UTC m=+2.124778068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108372    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-device-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108438    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-device-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4d9fc90-1881-4726-ac31-23e07c377c50-serviceca\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.177100 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-system-cni-dir\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-cnibin\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108548    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-multus-certs\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovnkube-config\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93b8d26c-2622-42d2-8114-24f24049e3e3-hosts-file\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-socket-dir-parent\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-system-cni-dir\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-run-multus-certs\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-cni-multus\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93b8d26c-2622-42d2-8114-24f24049e3e3-hosts-file\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-cnibin\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ftt9\" (UniqueName: \"kubernetes.io/projected/b213759c-39a6-4c31-a70c-3bee0064a026-kube-api-access-2ftt9\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.178129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108728    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-multus-socket-dir-parent\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-cni-multus\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-slash\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-cni-bin\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-slash\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-registration-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-cni-bin\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a4d9fc90-1881-4726-ac31-23e07c377c50-serviceca\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-cnibin\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-registration-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-cni-bin\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108920    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-cnibin\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108950    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-kubelet\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-cni-bin\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l86kg\" (UniqueName: \"kubernetes.io/projected/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-kube-api-access-l86kg\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.182696 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.108997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-host-var-lib-kubelet\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-kubelet\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-ovn\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-node-log\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-cni-binary-copy\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovnkube-script-lib\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b213759c-39a6-4c31-a70c-3bee0064a026-cni-binary-copy\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c-konnectivity-ca\") pod \"konnectivity-agent-vdttd\" (UID: \"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c\") " pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-node-log\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-env-overrides\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-run-ovn\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-kubelet\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.183375 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-etc-selinux\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109831    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-systemd-units\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovn-node-metrics-cert\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spqgn\" (UniqueName: \"kubernetes.io/projected/a4d9fc90-1881-4726-ac31-23e07c377c50-kube-api-access-spqgn\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.109969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-run-netns\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b213759c-39a6-4c31-a70c-3bee0064a026-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-systemd-units\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-cni-binary-copy\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-host-run-netns\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.110934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovnkube-script-lib\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.111301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c-konnectivity-ca\") pod \"konnectivity-agent-vdttd\" (UID: \"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c\") " pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.184052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.112033    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c-agent-certs\") pod \"konnectivity-agent-vdttd\" (UID: \"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c\") " pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.113735    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-ovn-node-metrics-cert\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.119506    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.119525    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.119538    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.119597    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:42.619580526 +0000 UTC m=+2.136178426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.121302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7cwx\" (UniqueName: \"kubernetes.io/projected/93b8d26c-2622-42d2-8114-24f24049e3e3-kube-api-access-t7cwx\") pod \"node-resolver-pl2dk\" (UID: \"93b8d26c-2622-42d2-8114-24f24049e3e3\") " pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.121639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgc28\" (UniqueName: \"kubernetes.io/projected/9344c26b-9551-4f9a-8248-00878963f706-kube-api-access-pgc28\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.128353    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l86kg\" (UniqueName: \"kubernetes.io/projected/c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2-kube-api-access-l86kg\") pod \"multus-5ddvh\" (UID: \"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2\") " pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.128913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ftt9\" (UniqueName: \"kubernetes.io/projected/b213759c-39a6-4c31-a70c-3bee0064a026-kube-api-access-2ftt9\") pod \"multus-additional-cni-plugins-jjl9j\" (UID: \"b213759c-39a6-4c31-a70c-3bee0064a026\") " pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.129073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kj72\" (UniqueName: \"kubernetes.io/projected/01a3792b-c2fb-4dd9-97f6-1a6600305fe6-kube-api-access-6kj72\") pod \"aws-ebs-csi-driver-node-xqqvw\" (UID: \"01a3792b-c2fb-4dd9-97f6-1a6600305fe6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.129385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwkz7\" (UniqueName: \"kubernetes.io/projected/4fd85dc7-f3c0-426d-acf4-774f4362a4c5-kube-api-access-cwkz7\") pod \"ovnkube-node-fshx8\" (UID: \"4fd85dc7-f3c0-426d-acf4-774f4362a4c5\") " pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.129622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw2vw\" (UniqueName: \"kubernetes.io/projected/97129229-9410-4726-a34c-262a5e337122-kube-api-access-bw2vw\") pod \"iptables-alerter-fwtxk\" (UID: \"97129229-9410-4726-a34c-262a5e337122\") " pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.185416 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.129788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spqgn\" (UniqueName: \"kubernetes.io/projected/a4d9fc90-1881-4726-ac31-23e07c377c50-kube-api-access-spqgn\") pod \"node-ca-nx2hc\" (UID: \"a4d9fc90-1881-4726-ac31-23e07c377c50\") " pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.186047 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.148625    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43acf0dee4ffc0ab3e3423a5eeb01c65.slice/crio-96a7b2032d406dfc40c0fc65d5e33b3c9388528effd04d30ce6088ff6eaa297e WatchSource:0}: Error finding container 96a7b2032d406dfc40c0fc65d5e33b3c9388528effd04d30ce6088ff6eaa297e: Status 404 returned error can't find the container with id 96a7b2032d406dfc40c0fc65d5e33b3c9388528effd04d30ce6088ff6eaa297e
Jul 16 17:28:42.186047 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.148845    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3369db8d39a147bcbc981aaa29066b97.slice/crio-a731768b87f609f8fe6cc4ddf791559d4ff1cf4d968330114643e5da4ee0f2b1 WatchSource:0}: Error finding container a731768b87f609f8fe6cc4ddf791559d4ff1cf4d968330114643e5da4ee0f2b1: Status 404 returned error can't find the container with id a731768b87f609f8fe6cc4ddf791559d4ff1cf4d968330114643e5da4ee0f2b1
Jul 16 17:28:42.186047 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.164601    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:28:42.186047 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.172293    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:28:42.186047 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.179702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw"
Jul 16 17:28:42.287235 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.196568    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21a7a130_2b42_4fe8_b9b5_fdfe57f73a2c.slice/crio-b63b1aaeb4ed9b1b4db7573615e63c06a8b97b8b9c027156331d9d7aa1ebc76d WatchSource:0}: Error finding container b63b1aaeb4ed9b1b4db7573615e63c06a8b97b8b9c027156331d9d7aa1ebc76d: Status 404 returned error can't find the container with id b63b1aaeb4ed9b1b4db7573615e63c06a8b97b8b9c027156331d9d7aa1ebc76d
Jul 16 17:28:42.287235 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.197336    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd85dc7_f3c0_426d_acf4_774f4362a4c5.slice/crio-7fe907256bbeb5e31563a1e8af5df8366dd9d73e12c6b4e68c89a990b2658a5a WatchSource:0}: Error finding container 7fe907256bbeb5e31563a1e8af5df8366dd9d73e12c6b4e68c89a990b2658a5a: Status 404 returned error can't find the container with id 7fe907256bbeb5e31563a1e8af5df8366dd9d73e12c6b4e68c89a990b2658a5a
Jul 16 17:28:42.287235 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.198460    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a3792b_c2fb_4dd9_97f6_1a6600305fe6.slice/crio-4d8627065bd17d0df0283db77cf0d67c8104522635f0bf5a3867e3a9f267b6d8 WatchSource:0}: Error finding container 4d8627065bd17d0df0283db77cf0d67c8104522635f0bf5a3867e3a9f267b6d8: Status 404 returned error can't find the container with id 4d8627065bd17d0df0283db77cf0d67c8104522635f0bf5a3867e3a9f267b6d8
Jul 16 17:28:42.287235 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.202525    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:28:42.287235 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.271550    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7bzvs"
Jul 16 17:28:42.287235 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.283467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pl2dk"
Jul 16 17:28:42.288870 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.287315    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nx2hc"
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.346797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jjl9j"
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.356457    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb213759c_39a6_4c31_a70c_3bee0064a026.slice/crio-5629e4f47061b04cddaa51fe7211c34c468508f40de4c97ab76959b04118fb11 WatchSource:0}: Error finding container 5629e4f47061b04cddaa51fe7211c34c468508f40de4c97ab76959b04118fb11: Status 404 returned error can't find the container with id 5629e4f47061b04cddaa51fe7211c34c468508f40de4c97ab76959b04118fb11
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.363256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5ddvh"
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.378537    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fwtxk"
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:28:42.390285    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97129229_9410_4726_a34c_262a5e337122.slice/crio-9981cc80339311fe1189eb7c00e3507b0ad9f867f6183f1562b58428d3a7e0b3 WatchSource:0}: Error finding container 9981cc80339311fe1189eb7c00e3507b0ad9f867f6183f1562b58428d3a7e0b3: Status 404 returned error can't find the container with id 9981cc80339311fe1189eb7c00e3507b0ad9f867f6183f1562b58428d3a7e0b3
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.391949    2577 kuberuntime_manager.go:1459] "Unhandled Error" err="container iptables-alerter start failed in pod iptables-alerter-fwtxk_openshift-network-operator(97129229-9410-4726-a34c-262a5e337122): ErrImagePull: pull QPS exceeded" logger="UnhandledError"
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.391980    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-fwtxk" podUID="97129229-9410-4726-a34c-262a5e337122"
Jul 16 17:28:42.454758 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.396204    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:28:42.610023 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.473497    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:28:42.615595 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.615176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:42.615595 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.615232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:42.615595 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.615344    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:42.615595 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.615427    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:43.615403959 +0000 UTC m=+3.132001857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:42.618095 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.615801    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:42.618095 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.615853    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:43.615838209 +0000 UTC m=+3.132436108 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:42.733664 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.716227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:42.733664 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.716415    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:28:42.733664 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.716431    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:28:42.733664 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.716440    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:42.733664 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.716488    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:43.716469103 +0000 UTC m=+3.233067012 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:42.991681 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.979460    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:23:42 +0000 UTC" deadline="2028-01-29 23:51:42.560451946 +0000 UTC"
Jul 16 17:28:42.991681 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.979512    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13494h22m59.580943581s"
Jul 16 17:28:42.991681 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.985474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal" event={"ID":"43acf0dee4ffc0ab3e3423a5eeb01c65","Type":"ContainerStarted","Data":"96a7b2032d406dfc40c0fc65d5e33b3c9388528effd04d30ce6088ff6eaa297e"}
Jul 16 17:28:42.991681 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.988663    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwtxk" event={"ID":"97129229-9410-4726-a34c-262a5e337122","Type":"ContainerStarted","Data":"9981cc80339311fe1189eb7c00e3507b0ad9f867f6183f1562b58428d3a7e0b3"}
Jul 16 17:28:42.991681 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:42.990970    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"iptables-alerter\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:81e3f2576c5145aebf33f0a2d300aef8b70217b00c31101b55ed112e7e2d0087\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-network-operator/iptables-alerter-fwtxk" podUID="97129229-9410-4726-a34c-262a5e337122"
Jul 16 17:28:42.995289 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.992698    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nx2hc" event={"ID":"a4d9fc90-1881-4726-ac31-23e07c377c50","Type":"ContainerStarted","Data":"86f6ae5d43f3eb6ea1f04ae29e54321d1cf172ce5e80feb32237819f35b20a61"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:42.997397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pl2dk" event={"ID":"93b8d26c-2622-42d2-8114-24f24049e3e3","Type":"ContainerStarted","Data":"42e3ddb72f192c5494bd439e590d307e818039fabaf67962f35250f870c9b544"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.001653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"7fe907256bbeb5e31563a1e8af5df8366dd9d73e12c6b4e68c89a990b2658a5a"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.004347    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw" event={"ID":"01a3792b-c2fb-4dd9-97f6-1a6600305fe6","Type":"ContainerStarted","Data":"4d8627065bd17d0df0283db77cf0d67c8104522635f0bf5a3867e3a9f267b6d8"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.006816    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal" event={"ID":"3369db8d39a147bcbc981aaa29066b97","Type":"ContainerStarted","Data":"a731768b87f609f8fe6cc4ddf791559d4ff1cf4d968330114643e5da4ee0f2b1"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.008458    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5ddvh" event={"ID":"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2","Type":"ContainerStarted","Data":"36666ea3b030870d9c8b5e39626b859a2ecd7cb47284d5503ccc5ef4f64a46d9"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.010000    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerStarted","Data":"5629e4f47061b04cddaa51fe7211c34c468508f40de4c97ab76959b04118fb11"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.012142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bzvs" event={"ID":"8d26e290-106a-401d-8992-a5293ae85021","Type":"ContainerStarted","Data":"56c3568ded8d6acef0d836e6d1cb612e9e593c7d0ee4f1c68dd0a2de4a014842"}
Jul 16 17:28:43.059278 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.014194    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vdttd" event={"ID":"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c","Type":"ContainerStarted","Data":"b63b1aaeb4ed9b1b4db7573615e63c06a8b97b8b9c027156331d9d7aa1ebc76d"}
Jul 16 17:28:43.257076 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.256969    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:28:43.628469 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.627641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:43.628469 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.627717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:43.628469 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.627864    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:43.628469 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.627931    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:45.627910357 +0000 UTC m=+5.144508260 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:43.628469 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.628330    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:43.628469 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.628378    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:45.628364069 +0000 UTC m=+5.144961973 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:43.728869 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.728613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:43.728869 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.728817    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:28:43.728869 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.728839    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:28:43.728869 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.728853    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:43.729238 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.728915    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:45.728896495 +0000 UTC m=+5.245494419 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:43.978137 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.977506    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:43.978137 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.977641    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:43.978137 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.977962    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:43.978137 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.978108    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:43.978541 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.978174    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:43.978541 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:43.978260    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:43.980635 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.980564    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:23:42 +0000 UTC" deadline="2028-03-22 01:05:17.486077963 +0000 UTC"
Jul 16 17:28:43.980635 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:43.980597    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14743h36m33.505485371s"
Jul 16 17:28:45.648184 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:45.647854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:45.648184 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:45.647939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:45.648184 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.648056    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:45.648184 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.648053    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:45.648184 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.648126    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:49.64810463 +0000 UTC m=+9.164702547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:45.648184 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.648157    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:49.648136327 +0000 UTC m=+9.164734242 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:45.749105 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:45.749064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:45.749289 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.749268    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:28:45.749365 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.749299    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:28:45.749365 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.749312    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:45.749501 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.749391    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:49.749354841 +0000 UTC m=+9.265952746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:45.977446 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:45.977409    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:45.977617 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.977541    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:45.977939 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:45.977920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:45.978026 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.978009    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:45.978099 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:45.978072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:45.978209 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:45.978156    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:47.977672 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:47.976870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:47.977672 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:47.977024    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:47.977672 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:47.977414    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:47.977672 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:47.977510    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:47.977672 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:47.977557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:47.977672 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:47.977631    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:49.681251 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:49.681177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:49.681702 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:49.681252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:49.681702 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.681379    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:49.681702 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.681381    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:49.681702 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.681438    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:57.681420484 +0000 UTC m=+17.198018390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:49.681702 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.681460    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:57.681448534 +0000 UTC m=+17.198046434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:49.782322 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:49.782288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:49.782512 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.782470    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:28:49.782512 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.782496    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:28:49.782512 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.782510    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:49.782680 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.782582    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:28:57.782562042 +0000 UTC m=+17.299159940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:49.976971 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:49.976887    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:49.976971 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:49.976916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:49.977190 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:49.976884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:49.977190 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.977007    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:49.977190 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.977085    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:49.977190 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:49.977160    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:51.977277 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:51.977242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:51.977745 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:51.977256    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:51.977745 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:51.977390    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:51.977745 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:51.977419    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:51.977745 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:51.977542    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:51.977745 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:51.977640    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:53.977488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:53.977410    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:53.977488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:53.977449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:53.977945 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:53.977511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:53.977945 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:53.977520    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:53.977945 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:53.977668    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:53.977945 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:53.977819    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:55.977478 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:55.977440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:55.977890 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:55.977491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:55.977890 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:55.977444    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:55.977890 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:55.977580    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:55.977890 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:55.977652    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:55.977890 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:55.977730    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:57.741987 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:57.741938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:57.742479 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:57.742019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:57.742479 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.742126    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:57.742479 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.742130    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:57.742479 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.742193    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:13.742172568 +0000 UTC m=+33.258770465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:28:57.742479 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.742215    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:13.742205679 +0000 UTC m=+33.258803575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:28:57.843105 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:57.843075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:57.843275 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.843207    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:28:57.843275 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.843225    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:28:57.843275 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.843236    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:57.843453 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.843282    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:13.843268995 +0000 UTC m=+33.359866896 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:28:57.976488 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:57.976459    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:57.976676 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:57.976512    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:57.976676 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:57.976570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:57.976676 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.976591    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:57.976676 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.976667    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:57.976875 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:57.976748    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:28:59.977171 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:59.976944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:28:59.977586 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:59.976972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:28:59.977586 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:59.977267    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:28:59.977586 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:28:59.976982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:28:59.977586 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:59.977369    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:28:59.977586 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:28:59.977446    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:01.977188 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:01.977158    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:01.977188 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:01.977190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:01.977590 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:01.977260    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:01.977590 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:01.977298    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:01.977590 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:01.977389    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:01.977590 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:01.977444    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:03.061255 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.060948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vdttd" event={"ID":"21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c","Type":"ContainerStarted","Data":"119c6506c8820fee71c706678068b44987e06e4547bfcaceac0aafdc980c2099"}
Jul 16 17:29:03.062379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.062353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal" event={"ID":"43acf0dee4ffc0ab3e3423a5eeb01c65","Type":"ContainerStarted","Data":"07132ab9456002f20c5d0acb3116d54bd9bd9c1b0cc96b74060f34b65d88e8ce"}
Jul 16 17:29:03.066285 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.066214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nx2hc" event={"ID":"a4d9fc90-1881-4726-ac31-23e07c377c50","Type":"ContainerStarted","Data":"fa0b0d3bf5ec067c44f59e66cff06cb52a7646646f28ea8422eefb237c61c6cb"}
Jul 16 17:29:03.067786 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.067762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pl2dk" event={"ID":"93b8d26c-2622-42d2-8114-24f24049e3e3","Type":"ContainerStarted","Data":"7089029bd9aa66b4b1bd4a01e9a105efba7c38ea6765cd28848b2f72e8aef918"}
Jul 16 17:29:03.069847 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.069827    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:29:03.070228 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.070205    2577 generic.go:356] "Generic (PLEG): container finished" podID="4fd85dc7-f3c0-426d-acf4-774f4362a4c5" containerID="dc0e375c6f7b749162c8fbc20cfe1c06b8975287e5960cbad007aafcde3d6f2a" exitCode=1
Jul 16 17:29:03.070298 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.070272    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"f463ec1ce63510d8e18852e06901e98cdaaf33adfcffa4b8eb666547e05a65a7"}
Jul 16 17:29:03.070383 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.070364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerDied","Data":"dc0e375c6f7b749162c8fbc20cfe1c06b8975287e5960cbad007aafcde3d6f2a"}
Jul 16 17:29:03.070441 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.070419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"34c000db0883ca452a51bc5b2f9ab2b736db1720f5aa7d030e637b07f2c66afb"}
Jul 16 17:29:03.071764 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.071745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw" event={"ID":"01a3792b-c2fb-4dd9-97f6-1a6600305fe6","Type":"ContainerStarted","Data":"d181cb91ca8f63bc4e2c6bc2e15cc0814961c72f231bbf04e4b4542cdacb1ce3"}
Jul 16 17:29:03.073169 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.073150    2577 generic.go:356] "Generic (PLEG): container finished" podID="3369db8d39a147bcbc981aaa29066b97" containerID="95574dc927cdb3c641324791bedb6e7d07ae99dbf8e513f3fdbac6689f7710ba" exitCode=0
Jul 16 17:29:03.073256 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.073209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal" event={"ID":"3369db8d39a147bcbc981aaa29066b97","Type":"ContainerDied","Data":"95574dc927cdb3c641324791bedb6e7d07ae99dbf8e513f3fdbac6689f7710ba"}
Jul 16 17:29:03.074669 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.074648    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5ddvh" event={"ID":"c309a13f-a6d2-46c7-8e67-4dbe2e7df3d2","Type":"ContainerStarted","Data":"961221dd2690284d81f1fe9209c60f3b24a4535c195e5eeb461daf15e3bf0e2e"}
Jul 16 17:29:03.076272 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.076254    2577 generic.go:356] "Generic (PLEG): container finished" podID="b213759c-39a6-4c31-a70c-3bee0064a026" containerID="ec91e702bbbf2cd180219d012c1ee9b6f40af9f77b67f50dd7b5c382abb685ce" exitCode=0
Jul 16 17:29:03.076363 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.076311    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerDied","Data":"ec91e702bbbf2cd180219d012c1ee9b6f40af9f77b67f50dd7b5c382abb685ce"}
Jul 16 17:29:03.077831 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.077812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7bzvs" event={"ID":"8d26e290-106a-401d-8992-a5293ae85021","Type":"ContainerStarted","Data":"f4406fb3734fa79889ec153fe67cfe882fa2599768c5073f009c822f7bad381c"}
Jul 16 17:29:03.127777 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.127737    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vdttd" podStartSLOduration=6.021288629 podStartE2EDuration="22.127722385s" totalImagesPullingTime="16.106433756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:03.100130223 +0000 UTC m=+22.616728140" watchObservedRunningTime="2026-07-16 17:29:03.127722385 +0000 UTC m=+22.644320282"
Jul 16 17:29:03.127875 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.127859    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7bzvs" podStartSLOduration=1.984912684 podStartE2EDuration="22.127854601s" totalImagesPullingTime="20.142941917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:03.126952119 +0000 UTC m=+22.643550055" watchObservedRunningTime="2026-07-16 17:29:03.127854601 +0000 UTC m=+22.644452528"
Jul 16 17:29:03.151815 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.151776    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pl2dk" podStartSLOduration=2.103557521 podStartE2EDuration="22.15176274s" totalImagesPullingTime="20.048205219s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:03.150972802 +0000 UTC m=+22.667570721" watchObservedRunningTime="2026-07-16 17:29:03.15176274 +0000 UTC m=+22.668360658"
Jul 16 17:29:03.218116 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.218076    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nx2hc" podStartSLOduration=2.100119562 podStartE2EDuration="22.218063716s" totalImagesPullingTime="20.117944154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:03.177060554 +0000 UTC m=+22.693658472" watchObservedRunningTime="2026-07-16 17:29:03.218063716 +0000 UTC m=+22.734661634"
Jul 16 17:29:03.270562 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.270519    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5ddvh" podStartSLOduration=2.172336057 podStartE2EDuration="22.270501038s" totalImagesPullingTime="20.098164981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:03.247247713 +0000 UTC m=+22.763845630" watchObservedRunningTime="2026-07-16 17:29:03.270501038 +0000 UTC m=+22.787098956"
Jul 16 17:29:03.270984 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.270953    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-187.ec2.internal" podStartSLOduration=21.270944671 podStartE2EDuration="21.270944671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:03.270383687 +0000 UTC m=+22.786981625" watchObservedRunningTime="2026-07-16 17:29:03.270944671 +0000 UTC m=+22.787542592"
Jul 16 17:29:03.976928 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.976902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:03.977081 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.976902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:03.977081 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:03.977027    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:03.977081 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:03.976902    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:03.977244 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:03.977100    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:03.977244 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:03.977155    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:04.083228 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.083191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fwtxk" event={"ID":"97129229-9410-4726-a34c-262a5e337122","Type":"ContainerStarted","Data":"2b813c323ded92a87d8a982798a8bf50407834306c07b5ecd0135c867f70e743"}
Jul 16 17:29:04.089582 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.089555    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:29:04.090364 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.090316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"c716c7130f5ee530cc2b63493fff08b558463fd7e5995748d8670616524aa4f0"}
Jul 16 17:29:04.090483 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.090448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"3a9cad41782f21cf0927eba82a7f845f17d61f16971f44091ad24558ced946fe"}
Jul 16 17:29:04.090543 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.090498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"3b96b7e5b173a681ceff1eac7615a0909f2588e61ed5417e5b124633f4263980"}
Jul 16 17:29:04.107031 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.106981    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fwtxk" podStartSLOduration=23.106962219 podStartE2EDuration="23.106962219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-16 17:29:04.106423557 +0000 UTC m=+23.623021499" watchObservedRunningTime="2026-07-16 17:29:04.106962219 +0000 UTC m=+23.623560138"
Jul 16 17:29:04.868012 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.867974    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 17:29:04.990354 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.990237    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:29:04.867994469Z","UUID":"4e25ed16-fe95-462b-a9f0-882f5190b9f3","Handler":null,"Name":"","Endpoint":""}
Jul 16 17:29:04.991537 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.991512    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 17:29:04.991652 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:04.991554    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 17:29:05.094259 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:05.094226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw" event={"ID":"01a3792b-c2fb-4dd9-97f6-1a6600305fe6","Type":"ContainerStarted","Data":"8c34ae3efacedbf85ca6e7a67058b1242739085901365d230244326ea6020df3"}
Jul 16 17:29:05.096095 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:05.096072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal" event={"ID":"3369db8d39a147bcbc981aaa29066b97","Type":"ContainerStarted","Data":"a5a3da0dc838302ff7f92fea73302a3e0164edef36fb9d01e67f80652c12d13c"}
Jul 16 17:29:05.114843 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:05.114799    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-187.ec2.internal" podStartSLOduration=23.114784427 podStartE2EDuration="23.114784427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:05.11406009 +0000 UTC m=+24.630658007" watchObservedRunningTime="2026-07-16 17:29:05.114784427 +0000 UTC m=+24.631382345"
Jul 16 17:29:05.977152 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:05.977115    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:05.977321 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:05.977212    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:05.977321 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:05.977119    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:05.977321 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:05.977258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:05.977513 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:05.977368    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:05.977513 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:05.977455    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:06.101780 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:06.101758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:29:06.102229 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:06.102120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"133339c113ffbdc8ba705e4ff80744856c1b9eba8c679063b927c5d9075235da"}
Jul 16 17:29:06.364216 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:06.364179    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:29:06.364791 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:06.364767    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:29:07.103932 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:07.103904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:29:07.104431 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:07.104414    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vdttd"
Jul 16 17:29:07.977226 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:07.977037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:07.977372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:07.977082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:07.977372 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:07.977260    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:07.977372 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:07.977083    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:07.977372 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:07.977360    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:07.977555 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:07.977453    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:08.109579 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.109557    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:29:08.110376 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.109981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"6529145dfc5ee1b7723d0e81567eb1e3aa831f11caa0cd8bf0b474a4938c4cb3"}
Jul 16 17:29:08.110376 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.110210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:29:08.110376 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.110272    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:29:08.110537 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.110382    2577 scope.go:117] "RemoveContainer" containerID="dc0e375c6f7b749162c8fbc20cfe1c06b8975287e5960cbad007aafcde3d6f2a"
Jul 16 17:29:08.112197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.112176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw" event={"ID":"01a3792b-c2fb-4dd9-97f6-1a6600305fe6","Type":"ContainerStarted","Data":"e26bd6dce9e79d3284e0fb5ba9e512233896dfba5ce25f0b3f4b30393d2b3444"}
Jul 16 17:29:08.113969 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.113943    2577 generic.go:356] "Generic (PLEG): container finished" podID="b213759c-39a6-4c31-a70c-3bee0064a026" containerID="1321ab6dd902ef1e76f5fcdb996de03868aad35d95a2dc3421ad1b72a56c7c70" exitCode=0
Jul 16 17:29:08.114057 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.114019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerDied","Data":"1321ab6dd902ef1e76f5fcdb996de03868aad35d95a2dc3421ad1b72a56c7c70"}
Jul 16 17:29:08.127526 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.127347    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:29:08.186668 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:08.186629    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xqqvw" podStartSLOduration=2.472911275 podStartE2EDuration="27.18661592s" totalImagesPullingTime="24.713704645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:08.1862028 +0000 UTC m=+27.702800745" watchObservedRunningTime="2026-07-16 17:29:08.18661592 +0000 UTC m=+27.703213838"
Jul 16 17:29:09.117817 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.117788    2577 generic.go:356] "Generic (PLEG): container finished" podID="b213759c-39a6-4c31-a70c-3bee0064a026" containerID="c59e2952fe6a1f82e6f64340b57510859eb09005b680b528b478bda4c12b7336" exitCode=0
Jul 16 17:29:09.118216 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.117899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerDied","Data":"c59e2952fe6a1f82e6f64340b57510859eb09005b680b528b478bda4c12b7336"}
Jul 16 17:29:09.121849 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.121832    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:29:09.122174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.122155    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" event={"ID":"4fd85dc7-f3c0-426d-acf4-774f4362a4c5","Type":"ContainerStarted","Data":"e952f4e1e1c58fb49b233850aacc6c98f5480d4bd0dc8fad50ac8ef45f9807d1"}
Jul 16 17:29:09.122855 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.122771    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:29:09.137112 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.137066    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:29:09.187122 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.187080    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8" podStartSLOduration=7.754214815 podStartE2EDuration="28.187063761s" totalImagesPullingTime="20.432848946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:09.186670969 +0000 UTC m=+28.703268905" watchObservedRunningTime="2026-07-16 17:29:09.187063761 +0000 UTC m=+28.703661679"
Jul 16 17:29:09.797104 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.797076    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vgz4v"]
Jul 16 17:29:09.797261 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.797229    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:09.797346 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:09.797314    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:09.802979 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.802951    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h69s6"]
Jul 16 17:29:09.803116 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.803085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:09.803192 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:09.803172    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:09.803677 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.803654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vwvlf"]
Jul 16 17:29:09.803765 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:09.803753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:09.803841 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:09.803822    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:11.128791 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:11.128760    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerStarted","Data":"6dcf7e31659068671951f571c30826b2fe5ceebe7f6356e36ae2631124e66914"}
Jul 16 17:29:11.976574 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:11.976501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:11.976574 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:11.976513    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:11.976773 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:11.976510    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:11.976773 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:11.976608    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:11.976773 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:11.976667    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:11.976773 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:11.976720    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:12.133026 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:12.132991    2577 generic.go:356] "Generic (PLEG): container finished" podID="b213759c-39a6-4c31-a70c-3bee0064a026" containerID="6dcf7e31659068671951f571c30826b2fe5ceebe7f6356e36ae2631124e66914" exitCode=0
Jul 16 17:29:12.133385 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:12.133046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerDied","Data":"6dcf7e31659068671951f571c30826b2fe5ceebe7f6356e36ae2631124e66914"}
Jul 16 17:29:13.757933 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:13.757711    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:13.758300 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:13.757981    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:13.758300 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.757868    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:13.758300 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.758078    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret podName:06858021-a732-4a5d-963d-2fe4b6a8a696 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:45.758055328 +0000 UTC m=+65.274653229 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret") pod "global-pull-secret-syncer-h69s6" (UID: "06858021-a732-4a5d-963d-2fe4b6a8a696") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:29:13.758300 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.758085    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:13.758300 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.758124    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:45.758112255 +0000 UTC m=+65.274710156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:29:13.858567 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:13.858535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:13.858727 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.858702    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:29:13.858778 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.858728    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:29:13.858778 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.858742    2577 projected.go:196] Error preparing data for projected volume kube-api-access-ftqz7 for pod openshift-network-diagnostics/network-check-target-vwvlf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:13.858844 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.858815    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7 podName:d4c99bbe-8be9-479d-a789-854291f04215 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:45.858795072 +0000 UTC m=+65.375392983 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-ftqz7" (UniqueName: "kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7") pod "network-check-target-vwvlf" (UID: "d4c99bbe-8be9-479d-a789-854291f04215") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:29:13.976628 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:13.976544    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:13.976628 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:13.976571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:13.976824 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:13.976545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:13.976824 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.976747    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vwvlf" podUID="d4c99bbe-8be9-479d-a789-854291f04215"
Jul 16 17:29:13.976824 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.976660    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h69s6" podUID="06858021-a732-4a5d-963d-2fe4b6a8a696"
Jul 16 17:29:13.976989 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:13.976837    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vgz4v" podUID="9344c26b-9551-4f9a-8248-00878963f706"
Jul 16 17:29:15.244119 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.244090    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-187.ec2.internal" event="NodeReady"
Jul 16 17:29:15.244551 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.244235    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 17:29:15.303912 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.303834    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58c644d5d5-v7qnl"]
Jul 16 17:29:15.308057 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.308028    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.310941 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.310800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wm2ng\""
Jul 16 17:29:15.310941 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.310823    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 17:29:15.310941 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.310832    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 17:29:15.310941 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.310860    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 17:29:15.316509 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.316315    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 17:29:15.325903 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.325850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c644d5d5-v7qnl"]
Jul 16 17:29:15.350281 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.350260    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-npbh7"]
Jul 16 17:29:15.353710 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.353694    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-td5rp"]
Jul 16 17:29:15.353845 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.353829    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.356850 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.356831    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 17:29:15.356948 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.356884    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.357322 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.357308    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 17:29:15.359301 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.359280    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4zxvh\""
Jul 16 17:29:15.359467 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.359449    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 17:29:15.359531 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.359507    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 17:29:15.359899 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.359884    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 17:29:15.361636 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.361617    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27n67\""
Jul 16 17:29:15.366033 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.366009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-npbh7"]
Jul 16 17:29:15.371669 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.371649    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-td5rp"]
Jul 16 17:29:15.470670 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhqgm\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-kube-api-access-hhqgm\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.470846 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkkx4\" (UniqueName: \"kubernetes.io/projected/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-kube-api-access-kkkx4\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.470846 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-trusted-ca\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.470846 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/8eba30df-7191-4311-9785-21b323d740f9-kube-api-access-pwcfj\") pod \"ingress-canary-td5rp\" (UID: \"8eba30df-7191-4311-9785-21b323d740f9\") " pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.470846 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.471035 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-bound-sa-token\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.471035 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-tmp-dir\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.471035 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eba30df-7191-4311-9785-21b323d740f9-cert\") pod \"ingress-canary-td5rp\" (UID: \"8eba30df-7191-4311-9785-21b323d740f9\") " pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.471035 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.470982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc516401-096a-48d3-9168-17c133456f13-ca-trust-extracted\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.471035 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.471006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-registry-certificates\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.471249 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.471042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-config-volume\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.471249 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.471064    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.471249 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.471085    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-image-registry-private-configuration\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.471249 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.471104    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-installation-pull-secrets\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.571622 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-image-registry-private-configuration\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-installation-pull-secrets\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:15.571674    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhqgm\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-kube-api-access-hhqgm\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkkx4\" (UniqueName: \"kubernetes.io/projected/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-kube-api-access-kkkx4\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:15.571758    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:29:16.071727893 +0000 UTC m=+35.588325789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:15.571785 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-trusted-ca\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571832    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/8eba30df-7191-4311-9785-21b323d740f9-kube-api-access-pwcfj\") pod \"ingress-canary-td5rp\" (UID: \"8eba30df-7191-4311-9785-21b323d740f9\") " pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-bound-sa-token\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-tmp-dir\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.571993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eba30df-7191-4311-9785-21b323d740f9-cert\") pod \"ingress-canary-td5rp\" (UID: \"8eba30df-7191-4311-9785-21b323d740f9\") " pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.572015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc516401-096a-48d3-9168-17c133456f13-ca-trust-extracted\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.572037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-registry-certificates\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.572060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-config-volume\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:15.572096    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:15.572126 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:15.572122    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:15.572622 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:15.572171    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:16.072154059 +0000 UTC m=+35.588751958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:15.572686 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.572637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-config-volume\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.573177 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.572803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-tmp-dir\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.573177 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.572911    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc516401-096a-48d3-9168-17c133456f13-ca-trust-extracted\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.573177 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.573126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-trusted-ca\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.573473 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.573210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-registry-certificates\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.576521 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.576496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-installation-pull-secrets\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.576651 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.576503    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-image-registry-private-configuration\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.576651 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.576569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8eba30df-7191-4311-9785-21b323d740f9-cert\") pod \"ingress-canary-td5rp\" (UID: \"8eba30df-7191-4311-9785-21b323d740f9\") " pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.590592 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.590562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcfj\" (UniqueName: \"kubernetes.io/projected/8eba30df-7191-4311-9785-21b323d740f9-kube-api-access-pwcfj\") pod \"ingress-canary-td5rp\" (UID: \"8eba30df-7191-4311-9785-21b323d740f9\") " pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.590713 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.590596    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhqgm\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-kube-api-access-hhqgm\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.591402 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.591377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkkx4\" (UniqueName: \"kubernetes.io/projected/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-kube-api-access-kkkx4\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:15.591550 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.591535    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-bound-sa-token\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:15.593477 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.593451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:15.671456 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.671418    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-td5rp"
Jul 16 17:29:15.703983 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.703954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:15.977313 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.977122    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:15.977478 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.977311    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:15.977478 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.977138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:15.980170 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.980150    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:29:15.980304 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.980177    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:29:15.980395 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.980380    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:29:15.980460 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.980436    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vscvt\""
Jul 16 17:29:15.980506 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.980457    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lggz\""
Jul 16 17:29:15.980662 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:15.980647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:29:16.077644 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:16.077618    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:16.077760 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:16.077712    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:16.077814 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:16.077771    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:16.077814 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:16.077787    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:16.077910 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:16.077816    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:16.077910 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:16.077842    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:17.077820942 +0000 UTC m=+36.594418851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:16.077910 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:16.077860    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:29:17.077849745 +0000 UTC m=+36.594447654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:16.140115 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:16.139975    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-td5rp"]
Jul 16 17:29:16.143955 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:16.143927    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eba30df_7191_4311_9785_21b323d740f9.slice/crio-636e85977716b97e8129e7be66db84e01b24f31f8a0195f4a6cf776534be9ab4 WatchSource:0}: Error finding container 636e85977716b97e8129e7be66db84e01b24f31f8a0195f4a6cf776534be9ab4: Status 404 returned error can't find the container with id 636e85977716b97e8129e7be66db84e01b24f31f8a0195f4a6cf776534be9ab4
Jul 16 17:29:16.144882 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:16.144861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerStarted","Data":"455056023d289c3fb2dcde1d2c693a00c8dcc44eee472dc8035ce7315e5d33f3"}
Jul 16 17:29:17.084909 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:17.084879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:17.085550 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:17.084940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:17.085550 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:17.085031    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:17.085550 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:17.085052    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:17.085550 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:17.085103    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:19.085087238 +0000 UTC m=+38.601685134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:17.085550 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:17.085033    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:17.085550 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:17.085152    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:29:19.085142005 +0000 UTC m=+38.601739906 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:17.148569 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:17.148542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-td5rp" event={"ID":"8eba30df-7191-4311-9785-21b323d740f9","Type":"ContainerStarted","Data":"636e85977716b97e8129e7be66db84e01b24f31f8a0195f4a6cf776534be9ab4"}
Jul 16 17:29:17.151052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:17.151027    2577 generic.go:356] "Generic (PLEG): container finished" podID="b213759c-39a6-4c31-a70c-3bee0064a026" containerID="455056023d289c3fb2dcde1d2c693a00c8dcc44eee472dc8035ce7315e5d33f3" exitCode=0
Jul 16 17:29:17.151160 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:17.151065    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerDied","Data":"455056023d289c3fb2dcde1d2c693a00c8dcc44eee472dc8035ce7315e5d33f3"}
Jul 16 17:29:18.157426 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:18.157393    2577 generic.go:356] "Generic (PLEG): container finished" podID="b213759c-39a6-4c31-a70c-3bee0064a026" containerID="74db344e466c8d8fbf3aeeb6df017c8c92677a1826d0175fc06b5b6c48fd4ac1" exitCode=0
Jul 16 17:29:18.157826 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:18.157440    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerDied","Data":"74db344e466c8d8fbf3aeeb6df017c8c92677a1826d0175fc06b5b6c48fd4ac1"}
Jul 16 17:29:19.100980 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.100946    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:19.101143 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.101011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:19.101143 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:19.101113    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:19.101143 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:19.101113    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:19.101236 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:19.101177    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:29:23.10116136 +0000 UTC m=+42.617759256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:19.101236 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:19.101123    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:19.101311 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:19.101248    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:23.101237933 +0000 UTC m=+42.617835833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:19.162740 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.162716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" event={"ID":"b213759c-39a6-4c31-a70c-3bee0064a026","Type":"ContainerStarted","Data":"e9a74cd79ed5aded22cd287a5209ae8b4b9a6b5e095131ab5adfa8ac810f125a"}
Jul 16 17:29:19.189242 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.189204    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jjl9j" podStartSLOduration=7.228859227 podStartE2EDuration="38.189190916s" totalImagesPullingTime="30.960331689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:19.188795066 +0000 UTC m=+38.705393019" watchObservedRunningTime="2026-07-16 17:29:19.189190916 +0000 UTC m=+38.705788833"
Jul 16 17:29:19.349045 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.348994    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:19.452166 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.452132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:19.567082 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:19.567049    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:20.166263 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:20.166228    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-td5rp" event={"ID":"8eba30df-7191-4311-9785-21b323d740f9","Type":"ContainerStarted","Data":"4550f649b62cc5317178e6162ff9173c9b32ccaa2618e308a2e3a5442f006d04"}
Jul 16 17:29:20.187364 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:20.187298    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-td5rp" podStartSLOduration=2.067295735 podStartE2EDuration="5.187283137s" totalImagesPullingTime="3.119987402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:20.186371361 +0000 UTC m=+39.702969279" watchObservedRunningTime="2026-07-16 17:29:20.187283137 +0000 UTC m=+39.703881077"
Jul 16 17:29:21.211397 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:21.211228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:21.314158 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:21.314120    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log" limit=1024
Jul 16 17:29:23.132575 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:23.132538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:23.132909 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:23.132600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:23.132909 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:23.132686    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:23.132909 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:23.132694    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:23.132909 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:23.132758    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:29:31.132741189 +0000 UTC m=+50.649339085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:23.132909 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:23.132699    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:23.132909 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:23.132833    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:31.132819085 +0000 UTC m=+50.649416984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:31.185136 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:31.185105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:31.185591 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:31.185156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:31.185591 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:31.185246    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:31.185591 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:31.185264    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:31.185591 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:31.185286    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:31.185591 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:31.185300    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:29:47.185288338 +0000 UTC m=+66.701886237 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:31.185591 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:31.185356    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:29:47.185320178 +0000 UTC m=+66.701918106 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:40.655308 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.655275    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6kkjt"]
Jul 16 17:29:40.678769 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.678745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6kkjt"]
Jul 16 17:29:40.678911 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.678838    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.681670 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.681647    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 16 17:29:40.681801 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.681648    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 17:29:40.682664 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.682646    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 17:29:40.682943 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.682926    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sj8qn\""
Jul 16 17:29:40.683286 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.683263    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 16 17:29:40.691701 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.691682    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 16 17:29:40.753834 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.753808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5570d77d-a138-4451-a204-e3e69019603e-tmp\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.753973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.753846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5570d77d-a138-4451-a204-e3e69019603e-snapshots\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.753973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.753866    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tqbj\" (UniqueName: \"kubernetes.io/projected/5570d77d-a138-4451-a204-e3e69019603e-kube-api-access-8tqbj\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.753973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.753901    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5570d77d-a138-4451-a204-e3e69019603e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.753973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.753951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5570d77d-a138-4451-a204-e3e69019603e-serving-cert\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.754146 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.754023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5570d77d-a138-4451-a204-e3e69019603e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.778880 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.778858    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"]
Jul 16 17:29:40.796898 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.796879    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"]
Jul 16 17:29:40.797014 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.796991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:40.799915 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.799870    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 16 17:29:40.800004 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.799898    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tjzp2\""
Jul 16 17:29:40.800004 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.799935    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:40.800140 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.800124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 16 17:29:40.854571 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5570d77d-a138-4451-a204-e3e69019603e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.854662 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854580    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4mh\" (UniqueName: \"kubernetes.io/projected/07b52005-16a7-4d3f-a6c3-ce055c86e27d-kube-api-access-wx4mh\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:40.854737 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5570d77d-a138-4451-a204-e3e69019603e-tmp\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.854770 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5570d77d-a138-4451-a204-e3e69019603e-snapshots\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.854770 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tqbj\" (UniqueName: \"kubernetes.io/projected/5570d77d-a138-4451-a204-e3e69019603e-kube-api-access-8tqbj\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.854834 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854788    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5570d77d-a138-4451-a204-e3e69019603e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.854834 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5570d77d-a138-4451-a204-e3e69019603e-serving-cert\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.854894 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.854836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:40.855293 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.855260    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5570d77d-a138-4451-a204-e3e69019603e-tmp\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.855408 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.855296    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5570d77d-a138-4451-a204-e3e69019603e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.855408 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.855350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/5570d77d-a138-4451-a204-e3e69019603e-snapshots\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.855491 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.855410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5570d77d-a138-4451-a204-e3e69019603e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.858751 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.858727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5570d77d-a138-4451-a204-e3e69019603e-serving-cert\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.868099 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.868081    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"]
Jul 16 17:29:40.874705 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.874686    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tqbj\" (UniqueName: \"kubernetes.io/projected/5570d77d-a138-4451-a204-e3e69019603e-kube-api-access-8tqbj\") pod \"insights-operator-68d9dd94cf-6kkjt\" (UID: \"5570d77d-a138-4451-a204-e3e69019603e\") " pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:40.893908 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.893889    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-dmw4k"]
Jul 16 17:29:40.894049 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.894025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:40.896765 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.896746    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 16 17:29:40.896870 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.896769    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 16 17:29:40.897752 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.897023    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 16 17:29:40.897752 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.897035    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rkggp\""
Jul 16 17:29:40.897752 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.897251    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:40.912504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.912460    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"]
Jul 16 17:29:40.912504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.912497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-dmw4k"]
Jul 16 17:29:40.912613 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.912566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:40.916089 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.916071    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:40.916361 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.916346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 17:29:40.916658 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.916630    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8j8pk\""
Jul 16 17:29:40.917136 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.917122    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 17:29:40.917199 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.917181    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 17:29:40.922282 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.922265    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 17:29:40.955646 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c18bd83-5189-4e2e-a1b4-1639b424383c-trusted-ca\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:40.955774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:40.955774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49a0d014-8620-44af-9fe7-0c48ab148bd3-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:40.955774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kzf8\" (UniqueName: \"kubernetes.io/projected/5c18bd83-5189-4e2e-a1b4-1639b424383c-kube-api-access-2kzf8\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:40.955774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c18bd83-5189-4e2e-a1b4-1639b424383c-config\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:40.955774 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c18bd83-5189-4e2e-a1b4-1639b424383c-serving-cert\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:40.956023 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955782    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhtzk\" (UniqueName: \"kubernetes.io/projected/49a0d014-8620-44af-9fe7-0c48ab148bd3-kube-api-access-dhtzk\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:40.956023 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4mh\" (UniqueName: \"kubernetes.io/projected/07b52005-16a7-4d3f-a6c3-ce055c86e27d-kube-api-access-wx4mh\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:40.956023 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.955832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49a0d014-8620-44af-9fe7-0c48ab148bd3-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:40.959073 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.959055    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 16 17:29:40.966378 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:40.966365    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 17:29:40.966447 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:40.966416    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls podName:07b52005-16a7-4d3f-a6c3-ce055c86e27d nodeName:}" failed. No retries permitted until 2026-07-16 17:29:41.466401314 +0000 UTC m=+60.982999210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls") pod "cluster-samples-operator-65db858894-rqhzj" (UID: "07b52005-16a7-4d3f-a6c3-ce055c86e27d") : secret "samples-operator-tls" not found
Jul 16 17:29:40.973613 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.973596    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 16 17:29:40.994386 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.994366    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:40.995146 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:40.995128    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-sj8qn\""
Jul 16 17:29:41.002539 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.002518    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4mh\" (UniqueName: \"kubernetes.io/projected/07b52005-16a7-4d3f-a6c3-ce055c86e27d-kube-api-access-wx4mh\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:41.002612 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.002577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt"
Jul 16 17:29:41.056141 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhtzk\" (UniqueName: \"kubernetes.io/projected/49a0d014-8620-44af-9fe7-0c48ab148bd3-kube-api-access-dhtzk\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.056260 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49a0d014-8620-44af-9fe7-0c48ab148bd3-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.056260 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c18bd83-5189-4e2e-a1b4-1639b424383c-trusted-ca\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.056260 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49a0d014-8620-44af-9fe7-0c48ab148bd3-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.056484 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056272    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kzf8\" (UniqueName: \"kubernetes.io/projected/5c18bd83-5189-4e2e-a1b4-1639b424383c-kube-api-access-2kzf8\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.056484 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056303    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c18bd83-5189-4e2e-a1b4-1639b424383c-config\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.056666 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c18bd83-5189-4e2e-a1b4-1639b424383c-serving-cert\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.056930 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.056907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/49a0d014-8620-44af-9fe7-0c48ab148bd3-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.057055 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.057034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5c18bd83-5189-4e2e-a1b4-1639b424383c-config\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.057093 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.057045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5c18bd83-5189-4e2e-a1b4-1639b424383c-trusted-ca\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.058524 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.058498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/49a0d014-8620-44af-9fe7-0c48ab148bd3-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.058904 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.058877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5c18bd83-5189-4e2e-a1b4-1639b424383c-serving-cert\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.076157 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.075883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kzf8\" (UniqueName: \"kubernetes.io/projected/5c18bd83-5189-4e2e-a1b4-1639b424383c-kube-api-access-2kzf8\") pod \"console-operator-7866497494-dmw4k\" (UID: \"5c18bd83-5189-4e2e-a1b4-1639b424383c\") " pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.094704 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.092800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhtzk\" (UniqueName: \"kubernetes.io/projected/49a0d014-8620-44af-9fe7-0c48ab148bd3-kube-api-access-dhtzk\") pod \"kube-storage-version-migrator-operator-799cb7f958-99ncm\" (UID: \"49a0d014-8620-44af-9fe7-0c48ab148bd3\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.149137 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.149111    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fshx8"
Jul 16 17:29:41.164593 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.164537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-6kkjt"]
Jul 16 17:29:41.167017 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:41.166989    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5570d77d_a138_4451_a204_e3e69019603e.slice/crio-ac21f6e0c1b4d37f79e77620c8ccff92f6c5cb2edd6c415d351cf0b15562c1b3 WatchSource:0}: Error finding container ac21f6e0c1b4d37f79e77620c8ccff92f6c5cb2edd6c415d351cf0b15562c1b3: Status 404 returned error can't find the container with id ac21f6e0c1b4d37f79e77620c8ccff92f6c5cb2edd6c415d351cf0b15562c1b3
Jul 16 17:29:41.202868 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.202840    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"
Jul 16 17:29:41.213662 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.213638    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt" event={"ID":"5570d77d-a138-4451-a204-e3e69019603e","Type":"ContainerStarted","Data":"ac21f6e0c1b4d37f79e77620c8ccff92f6c5cb2edd6c415d351cf0b15562c1b3"}
Jul 16 17:29:41.221798 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.221779    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:41.367044 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.367020    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm"]
Jul 16 17:29:41.369923 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:41.369901    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49a0d014_8620_44af_9fe7_0c48ab148bd3.slice/crio-bdf7a255c80aee0c1c6a33bf15d203bede3279f8c448416df1a6988f059e8a70 WatchSource:0}: Error finding container bdf7a255c80aee0c1c6a33bf15d203bede3279f8c448416df1a6988f059e8a70: Status 404 returned error can't find the container with id bdf7a255c80aee0c1c6a33bf15d203bede3279f8c448416df1a6988f059e8a70
Jul 16 17:29:41.383685 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.383664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-dmw4k"]
Jul 16 17:29:41.386440 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:41.386419    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c18bd83_5189_4e2e_a1b4_1639b424383c.slice/crio-bc8d2a4c51873b189bea3d8e7c1bf54fe9afe40d57dd5c6a97fcd011be7fc6fc WatchSource:0}: Error finding container bc8d2a4c51873b189bea3d8e7c1bf54fe9afe40d57dd5c6a97fcd011be7fc6fc: Status 404 returned error can't find the container with id bc8d2a4c51873b189bea3d8e7c1bf54fe9afe40d57dd5c6a97fcd011be7fc6fc
Jul 16 17:29:41.560764 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:41.560728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:41.560923 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:41.560879    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 17:29:41.560963 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:41.560938    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls podName:07b52005-16a7-4d3f-a6c3-ce055c86e27d nodeName:}" failed. No retries permitted until 2026-07-16 17:29:42.560922003 +0000 UTC m=+62.077519907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls") pod "cluster-samples-operator-65db858894-rqhzj" (UID: "07b52005-16a7-4d3f-a6c3-ce055c86e27d") : secret "samples-operator-tls" not found
Jul 16 17:29:42.218533 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:42.218494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-dmw4k" event={"ID":"5c18bd83-5189-4e2e-a1b4-1639b424383c","Type":"ContainerStarted","Data":"bc8d2a4c51873b189bea3d8e7c1bf54fe9afe40d57dd5c6a97fcd011be7fc6fc"}
Jul 16 17:29:42.220484 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:42.220453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm" event={"ID":"49a0d014-8620-44af-9fe7-0c48ab148bd3","Type":"ContainerStarted","Data":"bdf7a255c80aee0c1c6a33bf15d203bede3279f8c448416df1a6988f059e8a70"}
Jul 16 17:29:42.569547 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:42.569511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:42.569817 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:42.569722    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 17:29:42.569817 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:42.569783    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls podName:07b52005-16a7-4d3f-a6c3-ce055c86e27d nodeName:}" failed. No retries permitted until 2026-07-16 17:29:44.569765326 +0000 UTC m=+64.086363226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls") pod "cluster-samples-operator-65db858894-rqhzj" (UID: "07b52005-16a7-4d3f-a6c3-ce055c86e27d") : secret "samples-operator-tls" not found
Jul 16 17:29:44.587080 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:44.587055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:44.587471 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:44.587216    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 17:29:44.587471 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:44.587289    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls podName:07b52005-16a7-4d3f-a6c3-ce055c86e27d nodeName:}" failed. No retries permitted until 2026-07-16 17:29:48.587266927 +0000 UTC m=+68.103864823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls") pod "cluster-samples-operator-65db858894-rqhzj" (UID: "07b52005-16a7-4d3f-a6c3-ce055c86e27d") : secret "samples-operator-tls" not found
Jul 16 17:29:45.230064 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.230024    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm" event={"ID":"49a0d014-8620-44af-9fe7-0c48ab148bd3","Type":"ContainerStarted","Data":"165a7d3d792ddb792f139a8aaf148edb75055cfb163eddc58575e0cbd42be92c"}
Jul 16 17:29:45.231505 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.231476    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt" event={"ID":"5570d77d-a138-4451-a204-e3e69019603e","Type":"ContainerStarted","Data":"7a85c5c40c5fda61c0126e1b23bccf4be1e2663572575b902efab57961f31904"}
Jul 16 17:29:45.233177 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.233159    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/0.log"
Jul 16 17:29:45.233271 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.233199    2577 generic.go:356] "Generic (PLEG): container finished" podID="5c18bd83-5189-4e2e-a1b4-1639b424383c" containerID="e4c2d60ce45917c38d09401b35a0e976afd3b375241ad5a061f32bfea57ce9bb" exitCode=255
Jul 16 17:29:45.233271 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.233232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-dmw4k" event={"ID":"5c18bd83-5189-4e2e-a1b4-1639b424383c","Type":"ContainerDied","Data":"e4c2d60ce45917c38d09401b35a0e976afd3b375241ad5a061f32bfea57ce9bb"}
Jul 16 17:29:45.233465 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.233449    2577 scope.go:117] "RemoveContainer" containerID="e4c2d60ce45917c38d09401b35a0e976afd3b375241ad5a061f32bfea57ce9bb"
Jul 16 17:29:45.273516 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.273469    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm" podStartSLOduration=2.109447419 podStartE2EDuration="5.273448546s" totalImagesPullingTime="3.164001127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:45.272784647 +0000 UTC m=+64.789382566" watchObservedRunningTime="2026-07-16 17:29:45.273448546 +0000 UTC m=+64.790046466"
Jul 16 17:29:45.311224 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.311171    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt" podStartSLOduration=1.9499174460000002 podStartE2EDuration="5.311150701s" totalImagesPullingTime="3.361233255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:45.310560712 +0000 UTC m=+64.827158631" watchObservedRunningTime="2026-07-16 17:29:45.311150701 +0000 UTC m=+64.827748621"
Jul 16 17:29:45.796074 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.796041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:29:45.796535 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.796084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:45.799085 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.799034    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:29:45.799085 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.799035    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:29:45.806274 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:45.806256    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 17:29:45.806365 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:45.806318    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs podName:9344c26b-9551-4f9a-8248-00878963f706 nodeName:}" failed. No retries permitted until 2026-07-16 17:30:49.806300479 +0000 UTC m=+129.322898375 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs") pod "network-metrics-daemon-vgz4v" (UID: "9344c26b-9551-4f9a-8248-00878963f706") : secret "metrics-daemon-secret" not found
Jul 16 17:29:45.808482 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.808459    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06858021-a732-4a5d-963d-2fe4b6a8a696-original-pull-secret\") pod \"global-pull-secret-syncer-h69s6\" (UID: \"06858021-a732-4a5d-963d-2fe4b6a8a696\") " pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:45.897474 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.897448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:45.903047 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.903029    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:29:45.911057 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.911038    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:29:45.921345 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.921312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/d4c99bbe-8be9-479d-a789-854291f04215-kube-api-access-ftqz7\") pod \"network-check-target-vwvlf\" (UID: \"d4c99bbe-8be9-479d-a789-854291f04215\") " pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:45.991027 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.991000    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vscvt\""
Jul 16 17:29:45.995053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.995029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h69s6"
Jul 16 17:29:45.999135 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:45.999114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:46.146322 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.146282    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h69s6"]
Jul 16 17:29:46.148355 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:46.148312    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06858021_a732_4a5d_963d_2fe4b6a8a696.slice/crio-a5bc658949e0d38aa4a7132cf6b62e5cfddd6e8d4f63934b3933ea8454e73b92 WatchSource:0}: Error finding container a5bc658949e0d38aa4a7132cf6b62e5cfddd6e8d4f63934b3933ea8454e73b92: Status 404 returned error can't find the container with id a5bc658949e0d38aa4a7132cf6b62e5cfddd6e8d4f63934b3933ea8454e73b92
Jul 16 17:29:46.165228 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.165182    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vwvlf"]
Jul 16 17:29:46.169045 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:46.169024    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4c99bbe_8be9_479d_a789_854291f04215.slice/crio-2386e394e8a863a4f3b8a72c99d03c8114addfc0e2638ec245f81ce346bde6dd WatchSource:0}: Error finding container 2386e394e8a863a4f3b8a72c99d03c8114addfc0e2638ec245f81ce346bde6dd: Status 404 returned error can't find the container with id 2386e394e8a863a4f3b8a72c99d03c8114addfc0e2638ec245f81ce346bde6dd
Jul 16 17:29:46.238409 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.238387    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:29:46.238802 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.238789    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/0.log"
Jul 16 17:29:46.238850 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.238819    2577 generic.go:356] "Generic (PLEG): container finished" podID="5c18bd83-5189-4e2e-a1b4-1639b424383c" containerID="70eabb71e7da8f97a1afd27ac5312693554e337669d401130fdc4c8fe29d61d0" exitCode=255
Jul 16 17:29:46.238910 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.238892    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-dmw4k" event={"ID":"5c18bd83-5189-4e2e-a1b4-1639b424383c","Type":"ContainerDied","Data":"70eabb71e7da8f97a1afd27ac5312693554e337669d401130fdc4c8fe29d61d0"}
Jul 16 17:29:46.238957 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.238950    2577 scope.go:117] "RemoveContainer" containerID="e4c2d60ce45917c38d09401b35a0e976afd3b375241ad5a061f32bfea57ce9bb"
Jul 16 17:29:46.239140 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.239120    2577 scope.go:117] "RemoveContainer" containerID="70eabb71e7da8f97a1afd27ac5312693554e337669d401130fdc4c8fe29d61d0"
Jul 16 17:29:46.239340 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:46.239304    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-dmw4k_openshift-console-operator(5c18bd83-5189-4e2e-a1b4-1639b424383c)\"" pod="openshift-console-operator/console-operator-7866497494-dmw4k" podUID="5c18bd83-5189-4e2e-a1b4-1639b424383c"
Jul 16 17:29:46.243994 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.243966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vwvlf" event={"ID":"d4c99bbe-8be9-479d-a789-854291f04215","Type":"ContainerStarted","Data":"2386e394e8a863a4f3b8a72c99d03c8114addfc0e2638ec245f81ce346bde6dd"}
Jul 16 17:29:46.245127 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.245100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h69s6" event={"ID":"06858021-a732-4a5d-963d-2fe4b6a8a696","Type":"ContainerStarted","Data":"a5bc658949e0d38aa4a7132cf6b62e5cfddd6e8d4f63934b3933ea8454e73b92"}
Jul 16 17:29:46.506797 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.506720    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jtpl9"]
Jul 16 17:29:46.511282 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.511263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.513810 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.513792    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9mkk5\""
Jul 16 17:29:46.513981 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.513969    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 17:29:46.516791 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.516771    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 17:29:46.533439 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.533417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jtpl9"]
Jul 16 17:29:46.603586 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.603566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce7ddb54-c70f-4477-9e48-10af684a35ab-crio-socket\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.603695 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.603593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh8r6\" (UniqueName: \"kubernetes.io/projected/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-api-access-hh8r6\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.603695 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.603613    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7ddb54-c70f-4477-9e48-10af684a35ab-data-volume\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.603695 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.603682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.603828 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.603720    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.704918 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.704886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce7ddb54-c70f-4477-9e48-10af684a35ab-crio-socket\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.705069 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.704927    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh8r6\" (UniqueName: \"kubernetes.io/projected/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-api-access-hh8r6\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.705069 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.704951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7ddb54-c70f-4477-9e48-10af684a35ab-data-volume\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.705069 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.705007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.705069 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.705021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ce7ddb54-c70f-4477-9e48-10af684a35ab-crio-socket\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.705069 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.705038    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.705319 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:46.705105    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:29:46.705319 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:46.705143    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:46.705319 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:46.705170    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:47.20515119 +0000 UTC m=+66.721749128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : configmap "kube-rbac-proxy" not found
Jul 16 17:29:46.705319 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:46.705190    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:47.205177435 +0000 UTC m=+66.721775334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:46.705540 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.705364    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ce7ddb54-c70f-4477-9e48-10af684a35ab-data-volume\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:46.715924 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:46.715900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh8r6\" (UniqueName: \"kubernetes.io/projected/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-api-access-hh8r6\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:47.208501 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.208437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:29:47.208501 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.208494    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.208529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.208600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208610    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208649    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208678    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208686    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls podName:fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd nodeName:}" failed. No retries permitted until 2026-07-16 17:30:19.20866581 +0000 UTC m=+98.725263735 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls") pod "dns-default-npbh7" (UID: "fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd") : secret "dns-default-metrics-tls" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208695    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208707    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-58c644d5d5-v7qnl: secret "image-registry-tls" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208743    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:48.208725576 +0000 UTC m=+67.725323476 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208763    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:48.208754396 +0000 UTC m=+67.725352510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : configmap "kube-rbac-proxy" not found
Jul 16 17:29:47.209097 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.208777    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls podName:fc516401-096a-48d3-9168-17c133456f13 nodeName:}" failed. No retries permitted until 2026-07-16 17:30:19.208769379 +0000 UTC m=+98.725367277 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls") pod "image-registry-58c644d5d5-v7qnl" (UID: "fc516401-096a-48d3-9168-17c133456f13") : secret "image-registry-tls" not found
Jul 16 17:29:47.210396 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.210370    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"]
Jul 16 17:29:47.234283 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.234251    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"]
Jul 16 17:29:47.234415 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.234387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"
Jul 16 17:29:47.237447 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.237417    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mpf7h\""
Jul 16 17:29:47.237568 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.237547    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 17:29:47.237707 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.237688    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 17:29:47.251503 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.250914    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:29:47.251503 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.251259    2577 scope.go:117] "RemoveContainer" containerID="70eabb71e7da8f97a1afd27ac5312693554e337669d401130fdc4c8fe29d61d0"
Jul 16 17:29:47.251503 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:47.251452    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-dmw4k_openshift-console-operator(5c18bd83-5189-4e2e-a1b4-1639b424383c)\"" pod="openshift-console-operator/console-operator-7866497494-dmw4k" podUID="5c18bd83-5189-4e2e-a1b4-1639b424383c"
Jul 16 17:29:47.310161 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.310136    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67vg9\" (UniqueName: \"kubernetes.io/projected/bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052-kube-api-access-67vg9\") pod \"migrator-7f59b54f6c-z4bhg\" (UID: \"bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"
Jul 16 17:29:47.411754 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.411725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67vg9\" (UniqueName: \"kubernetes.io/projected/bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052-kube-api-access-67vg9\") pod \"migrator-7f59b54f6c-z4bhg\" (UID: \"bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"
Jul 16 17:29:47.422504 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.422464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67vg9\" (UniqueName: \"kubernetes.io/projected/bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052-kube-api-access-67vg9\") pod \"migrator-7f59b54f6c-z4bhg\" (UID: \"bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"
Jul 16 17:29:47.548084 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.548058    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"
Jul 16 17:29:47.711475 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:47.711445    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg"]
Jul 16 17:29:47.715234 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:47.715207    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8b6063_ec7c_4da4_a86a_ed2fc2e7c052.slice/crio-86727d65eab23624a9e87daaf7fca7e340532cce3fd289ff3674be0c6bfa8a7b WatchSource:0}: Error finding container 86727d65eab23624a9e87daaf7fca7e340532cce3fd289ff3674be0c6bfa8a7b: Status 404 returned error can't find the container with id 86727d65eab23624a9e87daaf7fca7e340532cce3fd289ff3674be0c6bfa8a7b
Jul 16 17:29:48.095824 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:48.095787    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pl2dk_93b8d26c-2622-42d2-8114-24f24049e3e3/dns-node-resolver/0.log"
Jul 16 17:29:48.218849 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:48.218817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:48.219269 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:48.218857    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:48.219269 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:48.218935    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:29:48.219269 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:48.218962    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:48.219269 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:48.219007    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:50.218988199 +0000 UTC m=+69.735586106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : configmap "kube-rbac-proxy" not found
Jul 16 17:29:48.219269 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:48.219025    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:50.219015647 +0000 UTC m=+69.735613547 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:48.254848 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:48.254826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg" event={"ID":"bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052","Type":"ContainerStarted","Data":"86727d65eab23624a9e87daaf7fca7e340532cce3fd289ff3674be0c6bfa8a7b"}
Jul 16 17:29:48.622710 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:48.622674    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:48.622892 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:48.622830    2577 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 16 17:29:48.622973 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:48.622892    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls podName:07b52005-16a7-4d3f-a6c3-ce055c86e27d nodeName:}" failed. No retries permitted until 2026-07-16 17:29:56.622876604 +0000 UTC m=+76.139474500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls") pod "cluster-samples-operator-65db858894-rqhzj" (UID: "07b52005-16a7-4d3f-a6c3-ce055c86e27d") : secret "samples-operator-tls" not found
Jul 16 17:29:49.296554 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:49.296523    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nx2hc_a4d9fc90-1881-4726-ac31-23e07c377c50/node-ca/0.log"
Jul 16 17:29:49.896440 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:49.896404    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-td5rp_8eba30df-7191-4311-9785-21b323d740f9/serve-healthcheck-canary/0.log"
Jul 16 17:29:50.021155 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.021114    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vmp8q"]
Jul 16 17:29:50.039052 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.038999    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vmp8q"]
Jul 16 17:29:50.039197 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.039126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.042428 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.042399    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 16 17:29:50.044588 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.043484    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 16 17:29:50.044588 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.043713    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8gl5x\""
Jul 16 17:29:50.044588 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.043944    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 16 17:29:50.044588 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.044137    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 16 17:29:50.137711 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.137677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tsn9\" (UniqueName: \"kubernetes.io/projected/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-kube-api-access-4tsn9\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.137886 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.137836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-signing-cabundle\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.137886 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.137863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-signing-key\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.239266 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.239184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:50.239266 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.239224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:50.239266 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.239241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-signing-cabundle\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.239614 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:50.239322    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:29:50.239614 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.239376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-signing-key\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.239614 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:50.239379    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:50.239614 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:50.239413    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:54.239391477 +0000 UTC m=+73.755989383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : configmap "kube-rbac-proxy" not found
Jul 16 17:29:50.239614 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:50.239462    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:29:54.239442866 +0000 UTC m=+73.756040776 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:50.239614 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.239555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tsn9\" (UniqueName: \"kubernetes.io/projected/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-kube-api-access-4tsn9\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.240013 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.239997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-signing-cabundle\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.242192 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.242167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-signing-key\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.254287 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.254266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tsn9\" (UniqueName: \"kubernetes.io/projected/b171260a-bac4-4a58-b3c2-53b5ad9dc43c-kube-api-access-4tsn9\") pod \"service-ca-79f68b9f4f-vmp8q\" (UID: \"b171260a-bac4-4a58-b3c2-53b5ad9dc43c\") " pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:50.351293 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:50.351242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q"
Jul 16 17:29:51.222464 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.222437    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:51.222570 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.222495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:29:51.223013 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.222993    2577 scope.go:117] "RemoveContainer" containerID="70eabb71e7da8f97a1afd27ac5312693554e337669d401130fdc4c8fe29d61d0"
Jul 16 17:29:51.223216 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:51.223186    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-dmw4k_openshift-console-operator(5c18bd83-5189-4e2e-a1b4-1639b424383c)\"" pod="openshift-console-operator/console-operator-7866497494-dmw4k" podUID="5c18bd83-5189-4e2e-a1b4-1639b424383c"
Jul 16 17:29:51.267425 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.266970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vwvlf" event={"ID":"d4c99bbe-8be9-479d-a789-854291f04215","Type":"ContainerStarted","Data":"6e6e274ad110747b8782cb7d42ea612bce18c1f7d3ffb16fb60223f96bca1999"}
Jul 16 17:29:51.267425 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.267092    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:29:51.294821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.294783    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vwvlf" podStartSLOduration=65.313190269 podStartE2EDuration="1m10.294767607s" totalImagesPullingTime="4.981577338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:51.293567057 +0000 UTC m=+70.810164999" watchObservedRunningTime="2026-07-16 17:29:51.294767607 +0000 UTC m=+70.811365572"
Jul 16 17:29:51.298284 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:51.298262    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-vmp8q"]
Jul 16 17:29:51.301786 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:29:51.301758    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb171260a_bac4_4a58_b3c2_53b5ad9dc43c.slice/crio-1b2591ea211cdf901f108e264ea55391227c862e8a00944b69029dabf7e98d86 WatchSource:0}: Error finding container 1b2591ea211cdf901f108e264ea55391227c862e8a00944b69029dabf7e98d86: Status 404 returned error can't find the container with id 1b2591ea211cdf901f108e264ea55391227c862e8a00944b69029dabf7e98d86
Jul 16 17:29:52.275062 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:52.275019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q" event={"ID":"b171260a-bac4-4a58-b3c2-53b5ad9dc43c","Type":"ContainerStarted","Data":"1b2591ea211cdf901f108e264ea55391227c862e8a00944b69029dabf7e98d86"}
Jul 16 17:29:52.276726 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:52.276690    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h69s6" event={"ID":"06858021-a732-4a5d-963d-2fe4b6a8a696","Type":"ContainerStarted","Data":"7b0aa3988a7c406fa9c00ae4edc2342cd99b055fbaf4bf41a8e2934945787c96"}
Jul 16 17:29:52.278715 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:52.278630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg" event={"ID":"bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052","Type":"ContainerStarted","Data":"2efe43077cbd2ff964b96c86ee622b6c731059328427be84a28c663c7858e791"}
Jul 16 17:29:52.278715 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:52.278687    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg" event={"ID":"bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052","Type":"ContainerStarted","Data":"dcb994fa02f8e8289c6d1ac66d34e5e813d7cdaedf2614fd55d4f59374c7e07b"}
Jul 16 17:29:52.296742 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:52.296658    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h69s6" podStartSLOduration=66.254809132 podStartE2EDuration="1m11.296643821s" totalImagesPullingTime="5.041834689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:52.295633697 +0000 UTC m=+71.812231641" watchObservedRunningTime="2026-07-16 17:29:52.296643821 +0000 UTC m=+71.813241792"
Jul 16 17:29:52.313939 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:52.313900    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-z4bhg" podStartSLOduration=1.828138587 podStartE2EDuration="5.313885671s" totalImagesPullingTime="3.485747084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:52.313271547 +0000 UTC m=+71.829869485" watchObservedRunningTime="2026-07-16 17:29:52.313885671 +0000 UTC m=+71.830483589"
Jul 16 17:29:54.276434 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:54.276387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:54.276434 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:54.276441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:29:54.276904 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:54.276542    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:54.276904 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:54.276605    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:30:02.276589776 +0000 UTC m=+81.793187672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:29:54.276904 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:54.276609    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:29:54.276904 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:29:54.276670    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:30:02.276651993 +0000 UTC m=+81.793249894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : configmap "kube-rbac-proxy" not found
Jul 16 17:29:54.287396 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:54.287364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q" event={"ID":"b171260a-bac4-4a58-b3c2-53b5ad9dc43c","Type":"ContainerStarted","Data":"636ca2c49ad15032981461fc1d9132d02f2a6783dc4472f2490a10ea3ebeaafe"}
Jul 16 17:29:54.312614 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:54.312574    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-vmp8q" podStartSLOduration=2.308387483 podStartE2EDuration="4.312559898s" totalImagesPullingTime="2.004172415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:54.310858396 +0000 UTC m=+73.827456333" watchObservedRunningTime="2026-07-16 17:29:54.312559898 +0000 UTC m=+73.829157835"
Jul 16 17:29:56.695745 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:56.695713    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:56.698016 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:56.697997    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/07b52005-16a7-4d3f-a6c3-ce055c86e27d-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-rqhzj\" (UID: \"07b52005-16a7-4d3f-a6c3-ce055c86e27d\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:56.709575 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:56.709551    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tjzp2\""
Jul 16 17:29:56.716643 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:56.716627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"
Jul 16 17:29:56.843979 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:56.843953    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj"]
Jul 16 17:29:57.298394 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:57.298356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj" event={"ID":"07b52005-16a7-4d3f-a6c3-ce055c86e27d","Type":"ContainerStarted","Data":"5044bef08ddf99416f0e610a0ddc73f187bd80248e8f43750c0388cdda9e3ce1"}
Jul 16 17:29:59.307016 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:59.306979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj" event={"ID":"07b52005-16a7-4d3f-a6c3-ce055c86e27d","Type":"ContainerStarted","Data":"0946a7ce5d217b487f110893f66eae0869425314de84519192dfba65a9164ecc"}
Jul 16 17:29:59.307437 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:59.307028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj" event={"ID":"07b52005-16a7-4d3f-a6c3-ce055c86e27d","Type":"ContainerStarted","Data":"cc1289bcec951fcbff9e6f09c6708d0548ad9c3320044ed5de51baefea8ef971"}
Jul 16 17:29:59.335517 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:29:59.335473    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-rqhzj" podStartSLOduration=17.485007415 podStartE2EDuration="19.33546032s" totalImagesPullingTime="1.850452905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:29:59.335171337 +0000 UTC m=+78.851769255" watchObservedRunningTime="2026-07-16 17:29:59.33546032 +0000 UTC m=+78.852058271"
Jul 16 17:30:02.339916 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:02.339879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:30:02.339916 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:02.339920    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:30:02.340373 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:30:02.340018    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:30:02.340373 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:30:02.340076    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls podName:ce7ddb54-c70f-4477-9e48-10af684a35ab nodeName:}" failed. No retries permitted until 2026-07-16 17:30:18.340061974 +0000 UTC m=+97.856659870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jtpl9" (UID: "ce7ddb54-c70f-4477-9e48-10af684a35ab") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:30:02.340481 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:02.340466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ce7ddb54-c70f-4477-9e48-10af684a35ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:30:04.977408 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:04.977254    2577 scope.go:117] "RemoveContainer" containerID="70eabb71e7da8f97a1afd27ac5312693554e337669d401130fdc4c8fe29d61d0"
Jul 16 17:30:05.326941 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:05.326914    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:30:05.327120 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:05.327022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-dmw4k" event={"ID":"5c18bd83-5189-4e2e-a1b4-1639b424383c","Type":"ContainerStarted","Data":"134e117e45a4c7e664a2bb9d13c4eb638e436e9241e78dcde9ae70c491c75f8c"}
Jul 16 17:30:05.327306 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:05.327290    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:30:05.352739 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:05.352688    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-dmw4k" podStartSLOduration=22.208254211 podStartE2EDuration="25.35267662s" totalImagesPullingTime="3.144422409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:05.352668668 +0000 UTC m=+84.869266587" watchObservedRunningTime="2026-07-16 17:30:05.35267662 +0000 UTC m=+84.869274538"
Jul 16 17:30:05.917244 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:05.917212    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-dmw4k"
Jul 16 17:30:10.862770 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.862733    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"]
Jul 16 17:30:10.865771 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.865755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:10.868992 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.868968    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-b97ts\""
Jul 16 17:30:10.869128 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.869014    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 17:30:10.869639 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.869623    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 17:30:10.870606 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.870587    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"]
Jul 16 17:30:10.873767 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.873747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:10.877067 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.877042    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 16 17:30:10.877161 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.877107    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 16 17:30:10.877803 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.877788    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 17:30:10.878045 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.878023    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 16 17:30:10.878132 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.878106    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 16 17:30:10.878203 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.878144    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 17:30:10.878258 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.878216    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 17:30:10.881702 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.881683    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"]
Jul 16 17:30:10.886763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:10.886739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"]
Jul 16 17:30:11.007262 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007236    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.007444 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb380f66-6030-4163-9433-6b32861c4532-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cw6cs\" (UID: \"cb380f66-6030-4163-9433-6b32861c4532\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.007444 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.007444 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.007444 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007408    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb380f66-6030-4163-9433-6b32861c4532-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cw6cs\" (UID: \"cb380f66-6030-4163-9433-6b32861c4532\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.007444 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-hub\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.007630 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007460    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-ca\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.007630 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.007487    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5zmc\" (UniqueName: \"kubernetes.io/projected/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-kube-api-access-h5zmc\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.108607 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.108765 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb380f66-6030-4163-9433-6b32861c4532-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cw6cs\" (UID: \"cb380f66-6030-4163-9433-6b32861c4532\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.108765 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108736    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.108869 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.108869 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb380f66-6030-4163-9433-6b32861c4532-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cw6cs\" (UID: \"cb380f66-6030-4163-9433-6b32861c4532\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.108869 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-hub\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.109012 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108891    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-ca\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.109012 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.108922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zmc\" (UniqueName: \"kubernetes.io/projected/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-kube-api-access-h5zmc\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.109397 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.109370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/cb380f66-6030-4163-9433-6b32861c4532-nginx-conf\") pod \"networking-console-plugin-6cf856758c-cw6cs\" (UID: \"cb380f66-6030-4163-9433-6b32861c4532\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.109562 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.109540    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.111323 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.111297    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.111323 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.111309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-ca\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.111623 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.111600    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cb380f66-6030-4163-9433-6b32861c4532-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-cw6cs\" (UID: \"cb380f66-6030-4163-9433-6b32861c4532\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.111672 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.111608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.111672 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.111609    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-hub\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.124274 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.124224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zmc\" (UniqueName: \"kubernetes.io/projected/ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3-kube-api-access-h5zmc\") pod \"cluster-proxy-proxy-agent-6f9f9f857f-lt8dc\" (UID: \"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.175062 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.175036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"
Jul 16 17:30:11.193250 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.193230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"
Jul 16 17:30:11.314916 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.314888    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-cw6cs"]
Jul 16 17:30:11.317622 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:11.317595    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb380f66_6030_4163_9433_6b32861c4532.slice/crio-71c114ff4244f96bc8098e95e4bed548db0a49994c02cf6b1b9bdd595a619a2c WatchSource:0}: Error finding container 71c114ff4244f96bc8098e95e4bed548db0a49994c02cf6b1b9bdd595a619a2c: Status 404 returned error can't find the container with id 71c114ff4244f96bc8098e95e4bed548db0a49994c02cf6b1b9bdd595a619a2c
Jul 16 17:30:11.343009 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.342984    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc"]
Jul 16 17:30:11.346486 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:11.346464    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffd47ce1_e64f_4813_bfed_8a02e9bdb9f3.slice/crio-eb059b98829bcf62506092f0267476566f4bdade14500b0e5fb4aa426de93ff7 WatchSource:0}: Error finding container eb059b98829bcf62506092f0267476566f4bdade14500b0e5fb4aa426de93ff7: Status 404 returned error can't find the container with id eb059b98829bcf62506092f0267476566f4bdade14500b0e5fb4aa426de93ff7
Jul 16 17:30:11.349595 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:11.349568    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs" event={"ID":"cb380f66-6030-4163-9433-6b32861c4532","Type":"ContainerStarted","Data":"71c114ff4244f96bc8098e95e4bed548db0a49994c02cf6b1b9bdd595a619a2c"}
Jul 16 17:30:12.357476 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:12.357400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc" event={"ID":"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3","Type":"ContainerStarted","Data":"eb059b98829bcf62506092f0267476566f4bdade14500b0e5fb4aa426de93ff7"}
Jul 16 17:30:13.363234 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:13.363195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs" event={"ID":"cb380f66-6030-4163-9433-6b32861c4532","Type":"ContainerStarted","Data":"32669bb1fbdd4a2a6a500fe536f4c56414c9e2e0d0b1d04dc6b39d2ee347be63"}
Jul 16 17:30:13.383532 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:13.383483    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-cw6cs" podStartSLOduration=1.969356081 podStartE2EDuration="3.383465744s" totalImagesPullingTime="1.414109663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:13.381898054 +0000 UTC m=+92.898496008" watchObservedRunningTime="2026-07-16 17:30:13.383465744 +0000 UTC m=+92.900063661"
Jul 16 17:30:15.373165 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:15.373088    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc" event={"ID":"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3","Type":"ContainerStarted","Data":"11f9ec3fc1055bbd56ebc2147bcf45d10ee96fce973ec3e9872d76e2611bf122"}
Jul 16 17:30:15.373165 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:15.373130    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc" event={"ID":"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3","Type":"ContainerStarted","Data":"e62edf358b0631a294a86da9279c95f2847aa7bb61a16c708349aeedd9887a6d"}
Jul 16 17:30:15.373165 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:15.373142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc" event={"ID":"ffd47ce1-e64f-4813-bfed-8a02e9bdb9f3","Type":"ContainerStarted","Data":"5248b3c3b838068723d07c061ae95487d8a7d65adcfe265a743bf7579e01a1c6"}
Jul 16 17:30:15.398027 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:15.397986    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f9f857f-lt8dc" podStartSLOduration=1.685466195 podStartE2EDuration="5.397970621s" totalImagesPullingTime="3.712504426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:15.397169055 +0000 UTC m=+94.913766992" watchObservedRunningTime="2026-07-16 17:30:15.397970621 +0000 UTC m=+94.914568597"
Jul 16 17:30:18.368928 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:18.368894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:30:18.371114 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:18.371095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ce7ddb54-c70f-4477-9e48-10af684a35ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jtpl9\" (UID: \"ce7ddb54-c70f-4477-9e48-10af684a35ab\") " pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:30:18.619938 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:18.619846    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jtpl9"
Jul 16 17:30:18.742844 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:18.742817    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jtpl9"]
Jul 16 17:30:18.745672 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:18.745643    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce7ddb54_c70f_4477_9e48_10af684a35ab.slice/crio-86c1ca7b1db05cb570431d04476e33886f86e4d39533341aeeb69306eb86f02a WatchSource:0}: Error finding container 86c1ca7b1db05cb570431d04476e33886f86e4d39533341aeeb69306eb86f02a: Status 404 returned error can't find the container with id 86c1ca7b1db05cb570431d04476e33886f86e4d39533341aeeb69306eb86f02a
Jul 16 17:30:19.277086 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.277037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:19.277285 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.277123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:30:19.280418 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.280390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd-metrics-tls\") pod \"dns-default-npbh7\" (UID: \"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd\") " pod="openshift-dns/dns-default-npbh7"
Jul 16 17:30:19.280553 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.280458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"image-registry-58c644d5d5-v7qnl\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") " pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:19.388682 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.388489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtpl9" event={"ID":"ce7ddb54-c70f-4477-9e48-10af684a35ab","Type":"ContainerStarted","Data":"86c1ca7b1db05cb570431d04476e33886f86e4d39533341aeeb69306eb86f02a"}
Jul 16 17:30:19.522648 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.522615    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wm2ng\""
Jul 16 17:30:19.530157 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.530082    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:19.567446 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.567234    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-27n67\""
Jul 16 17:30:19.575858 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.575706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-npbh7"
Jul 16 17:30:19.711619 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.711373    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58c644d5d5-v7qnl"]
Jul 16 17:30:19.718687 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:19.718651    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc516401_096a_48d3_9168_17c133456f13.slice/crio-a133136174f57766214ce72e24a962f3c0175be805074d35339bdc7fa7e2ca8f WatchSource:0}: Error finding container a133136174f57766214ce72e24a962f3c0175be805074d35339bdc7fa7e2ca8f: Status 404 returned error can't find the container with id a133136174f57766214ce72e24a962f3c0175be805074d35339bdc7fa7e2ca8f
Jul 16 17:30:19.755376 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:19.755345    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-npbh7"]
Jul 16 17:30:19.759562 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:19.759485    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc1b7b02_5c48_47c9_8e71_0cf4fa0794dd.slice/crio-3a4a6dd68bc0a09892034132dd3b194eb05c366475066d0bc40b850d2b5c8e2e WatchSource:0}: Error finding container 3a4a6dd68bc0a09892034132dd3b194eb05c366475066d0bc40b850d2b5c8e2e: Status 404 returned error can't find the container with id 3a4a6dd68bc0a09892034132dd3b194eb05c366475066d0bc40b850d2b5c8e2e
Jul 16 17:30:20.394990 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:20.394950    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-npbh7" event={"ID":"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd","Type":"ContainerStarted","Data":"3a4a6dd68bc0a09892034132dd3b194eb05c366475066d0bc40b850d2b5c8e2e"}
Jul 16 17:30:20.397678 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:20.397589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl" event={"ID":"fc516401-096a-48d3-9168-17c133456f13","Type":"ContainerStarted","Data":"b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e"}
Jul 16 17:30:20.397678 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:20.397643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl" event={"ID":"fc516401-096a-48d3-9168-17c133456f13","Type":"ContainerStarted","Data":"a133136174f57766214ce72e24a962f3c0175be805074d35339bdc7fa7e2ca8f"}
Jul 16 17:30:20.397891 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:20.397759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:20.423780 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:20.423686    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl" podStartSLOduration=98.42366417 podStartE2EDuration="1m38.42366417s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:20.422538929 +0000 UTC m=+99.939136871" watchObservedRunningTime="2026-07-16 17:30:20.42366417 +0000 UTC m=+99.940262090"
Jul 16 17:30:22.281773 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:22.281741    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vwvlf"
Jul 16 17:30:25.418039 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:25.418003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtpl9" event={"ID":"ce7ddb54-c70f-4477-9e48-10af684a35ab","Type":"ContainerStarted","Data":"c4d68185168b15af51e1226d710fe981541caacd0735097a0a1baf58a3197a91"}
Jul 16 17:30:25.419679 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:25.419647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-npbh7" event={"ID":"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd","Type":"ContainerStarted","Data":"029ce7300f64907a7fb6944c94ad7567b6f3d76c6250ecdf52b8e25541e8bcb4"}
Jul 16 17:30:25.419796 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:25.419695    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-npbh7" event={"ID":"fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd","Type":"ContainerStarted","Data":"5a5d422192e10a604d45b5eb7578c3b852f4b5cb6292104f846001dec5fec4ee"}
Jul 16 17:30:25.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:25.419793    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-npbh7"
Jul 16 17:30:25.447806 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:25.447764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-npbh7" podStartSLOduration=65.508999419 podStartE2EDuration="1m10.447749798s" totalImagesPullingTime="4.938750379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:25.445912426 +0000 UTC m=+104.962510355" watchObservedRunningTime="2026-07-16 17:30:25.447749798 +0000 UTC m=+104.964347715"
Jul 16 17:30:29.435973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:29.435936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtpl9" event={"ID":"ce7ddb54-c70f-4477-9e48-10af684a35ab","Type":"ContainerStarted","Data":"408a866d5e15ead67efd304ff37b4a0503ea16ee40ea2abad9b185c71993bb1a"}
Jul 16 17:30:31.529019 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.528986    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7k76m"]
Jul 16 17:30:31.533946 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.533641    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.543145 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.543082    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 17:30:31.543958 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.543912    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 17:30:31.544079 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.543917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nmknv\""
Jul 16 17:30:31.545422 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.545404    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 17:30:31.545529 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.545404    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 17:30:31.545529 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.545437    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 17:30:31.557016 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.556987    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 17:30:31.577508 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577508 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-root\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577711 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577548    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98fa2bb9-5fc6-4d63-951d-e8248da075b8-metrics-client-ca\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577711 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvgzq\" (UniqueName: \"kubernetes.io/projected/98fa2bb9-5fc6-4d63-951d-e8248da075b8-kube-api-access-gvgzq\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577711 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-wtmp\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577711 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-textfile\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577913 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577745    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-tls\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577913 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-sys\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.577913 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.577889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.678921 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.678868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvgzq\" (UniqueName: \"kubernetes.io/projected/98fa2bb9-5fc6-4d63-951d-e8248da075b8-kube-api-access-gvgzq\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679104 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.678930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-wtmp\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679104 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.678961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-textfile\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679104 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.678985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-tls\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679104 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-sys\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679104 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679401 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679401 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-root\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679401 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98fa2bb9-5fc6-4d63-951d-e8248da075b8-metrics-client-ca\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679401 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-wtmp\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679401 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-textfile\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679661 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-sys\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679714 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/98fa2bb9-5fc6-4d63-951d-e8248da075b8-root\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679827 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98fa2bb9-5fc6-4d63-951d-e8248da075b8-metrics-client-ca\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.679973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.679874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.681750 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.681731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-tls\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.681845 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.681787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/98fa2bb9-5fc6-4d63-951d-e8248da075b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.695319 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.695298    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvgzq\" (UniqueName: \"kubernetes.io/projected/98fa2bb9-5fc6-4d63-951d-e8248da075b8-kube-api-access-gvgzq\") pod \"node-exporter-7k76m\" (UID: \"98fa2bb9-5fc6-4d63-951d-e8248da075b8\") " pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:31.845426 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:31.845350    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7k76m"
Jul 16 17:30:32.718101 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:32.718063    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98fa2bb9_5fc6_4d63_951d_e8248da075b8.slice/crio-02225fb33a05d109ea8fb9de399a8299e6ec1c3892fd40942e5241b164cba2ea WatchSource:0}: Error finding container 02225fb33a05d109ea8fb9de399a8299e6ec1c3892fd40942e5241b164cba2ea: Status 404 returned error can't find the container with id 02225fb33a05d109ea8fb9de399a8299e6ec1c3892fd40942e5241b164cba2ea
Jul 16 17:30:33.222879 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:33.222847    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58c644d5d5-v7qnl"]
Jul 16 17:30:33.454028 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:33.453995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k76m" event={"ID":"98fa2bb9-5fc6-4d63-951d-e8248da075b8","Type":"ContainerStarted","Data":"02225fb33a05d109ea8fb9de399a8299e6ec1c3892fd40942e5241b164cba2ea"}
Jul 16 17:30:33.455901 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:33.455868    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jtpl9" event={"ID":"ce7ddb54-c70f-4477-9e48-10af684a35ab","Type":"ContainerStarted","Data":"02159eab7596f3a35c10ef6506a70ae06a6fbc6655aed883cc51bd3f4d02c4d7"}
Jul 16 17:30:33.491955 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:33.491868    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jtpl9" podStartSLOduration=33.64376552 podStartE2EDuration="47.491852383s" totalImagesPullingTime="13.848086863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:29:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:33.49115643 +0000 UTC m=+113.007754361" watchObservedRunningTime="2026-07-16 17:30:33.491852383 +0000 UTC m=+113.008450301"
Jul 16 17:30:34.460678 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:34.460648    2577 generic.go:356] "Generic (PLEG): container finished" podID="98fa2bb9-5fc6-4d63-951d-e8248da075b8" containerID="40f507a88b972430a6d5958b06881e102a7d4d6a53522465cb3c549f413b8867" exitCode=0
Jul 16 17:30:34.461050 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:34.460730    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k76m" event={"ID":"98fa2bb9-5fc6-4d63-951d-e8248da075b8","Type":"ContainerDied","Data":"40f507a88b972430a6d5958b06881e102a7d4d6a53522465cb3c549f413b8867"}
Jul 16 17:30:35.425744 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:35.425715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-npbh7"
Jul 16 17:30:35.469937 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:35.469900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k76m" event={"ID":"98fa2bb9-5fc6-4d63-951d-e8248da075b8","Type":"ContainerStarted","Data":"6d45c273e6efd76f2d37500fd3cd4329538ffbc5af0601f16642b853ee257f74"}
Jul 16 17:30:35.470412 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:35.469967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k76m" event={"ID":"98fa2bb9-5fc6-4d63-951d-e8248da075b8","Type":"ContainerStarted","Data":"0baa7b884e0cc7456c1667bb552f2f38a2aa1e36459189d2a353999fa5dc995e"}
Jul 16 17:30:43.227755 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:43.227730    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:43.250459 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:43.250411    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7k76m" podStartSLOduration=10.675226281 podStartE2EDuration="12.250396556s" totalImagesPullingTime="1.513399429s" totalInitContainerRuntime="61.770846ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:35.500985146 +0000 UTC m=+115.017583064" watchObservedRunningTime="2026-07-16 17:30:43.250396556 +0000 UTC m=+122.766994472"
Jul 16 17:30:49.812305 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:49.812256    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:30:49.814485 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:49.814457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9344c26b-9551-4f9a-8248-00878963f706-metrics-certs\") pod \"network-metrics-daemon-vgz4v\" (UID: \"9344c26b-9551-4f9a-8248-00878963f706\") " pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:30:49.906998 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:49.906970    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4lggz\""
Jul 16 17:30:49.913928 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:49.913900    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vgz4v"
Jul 16 17:30:50.043686 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:50.043654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vgz4v"]
Jul 16 17:30:50.046748 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:30:50.046724    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9344c26b_9551_4f9a_8248_00878963f706.slice/crio-953ec7ffe7aa4cb43590b740c72092be0e42fdfc7db1cce2c1af3c2ab8119caf WatchSource:0}: Error finding container 953ec7ffe7aa4cb43590b740c72092be0e42fdfc7db1cce2c1af3c2ab8119caf: Status 404 returned error can't find the container with id 953ec7ffe7aa4cb43590b740c72092be0e42fdfc7db1cce2c1af3c2ab8119caf
Jul 16 17:30:50.521593 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:50.521555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vgz4v" event={"ID":"9344c26b-9551-4f9a-8248-00878963f706","Type":"ContainerStarted","Data":"953ec7ffe7aa4cb43590b740c72092be0e42fdfc7db1cce2c1af3c2ab8119caf"}
Jul 16 17:30:51.527590 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:51.527555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vgz4v" event={"ID":"9344c26b-9551-4f9a-8248-00878963f706","Type":"ContainerStarted","Data":"ad35198739951eea495f2b01378369b5497651f86a837ac27ecdda3dfb711cc3"}
Jul 16 17:30:51.527959 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:51.527603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vgz4v" event={"ID":"9344c26b-9551-4f9a-8248-00878963f706","Type":"ContainerStarted","Data":"ddf3509da808f7c71c586ddb6a021c444c2030249907f2cccc475fbb39793291"}
Jul 16 17:30:51.552074 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:51.552027    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vgz4v" podStartSLOduration=129.743884695 podStartE2EDuration="2m10.552014695s" totalImagesPullingTime="808.13ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:28:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:30:51.550531305 +0000 UTC m=+131.067129240" watchObservedRunningTime="2026-07-16 17:30:51.552014695 +0000 UTC m=+131.068612613"
Jul 16 17:30:58.242185 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.242139    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl" podUID="fc516401-096a-48d3-9168-17c133456f13" containerName="registry" containerID="cri-o://b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e" gracePeriod=30
Jul 16 17:30:58.483740 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.483716    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:58.554071 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.554040    2577 generic.go:356] "Generic (PLEG): container finished" podID="fc516401-096a-48d3-9168-17c133456f13" containerID="b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e" exitCode=0
Jul 16 17:30:58.554206 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.554087    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl"
Jul 16 17:30:58.554206 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.554125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl" event={"ID":"fc516401-096a-48d3-9168-17c133456f13","Type":"ContainerDied","Data":"b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e"}
Jul 16 17:30:58.554206 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.554199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58c644d5d5-v7qnl" event={"ID":"fc516401-096a-48d3-9168-17c133456f13","Type":"ContainerDied","Data":"a133136174f57766214ce72e24a962f3c0175be805074d35339bdc7fa7e2ca8f"}
Jul 16 17:30:58.554405 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.554220    2577 scope.go:117] "RemoveContainer" containerID="b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e"
Jul 16 17:30:58.561928 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.561911    2577 scope.go:117] "RemoveContainer" containerID="b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e"
Jul 16 17:30:58.562187 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:30:58.562169    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e\": container with ID starting with b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e not found: ID does not exist" containerID="b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e"
Jul 16 17:30:58.562235 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.562195    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e"} err="failed to get container status \"b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e\": rpc error: code = NotFound desc = could not find container \"b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e\": container with ID starting with b8364adeb854579192fa1d50289f5ab35b8ded3bef13f87521b77560db7c297e not found: ID does not exist"
Jul 16 17:30:58.577455 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577437    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-image-registry-private-configuration\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577543 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577469    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-bound-sa-token\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577543 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577499    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hhqgm\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-kube-api-access-hhqgm\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577543 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577522    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-installation-pull-secrets\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc516401-096a-48d3-9168-17c133456f13-ca-trust-extracted\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577762 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577750    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-registry-certificates\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577810 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577785    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.577870 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.577843    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-trusted-ca\") pod \"fc516401-096a-48d3-9168-17c133456f13\" (UID: \"fc516401-096a-48d3-9168-17c133456f13\") "
Jul 16 17:30:58.578368 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.578173    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:30:58.578508 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.578473    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:30:58.579799 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.579765    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:30:58.580085 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.580059    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:30:58.580085 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.580068    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-kube-api-access-hhqgm" (OuterVolumeSpecName: "kube-api-access-hhqgm") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "kube-api-access-hhqgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:30:58.580206 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.580102    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:30:58.580280 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.580260    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:30:58.586155 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.586130    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc516401-096a-48d3-9168-17c133456f13-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "fc516401-096a-48d3-9168-17c133456f13" (UID: "fc516401-096a-48d3-9168-17c133456f13"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:30:58.678731 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678698    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-image-registry-private-configuration\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678731 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678722    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-bound-sa-token\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678731 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678732    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hhqgm\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-kube-api-access-hhqgm\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678923 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678740    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc516401-096a-48d3-9168-17c133456f13-installation-pull-secrets\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678923 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678749    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc516401-096a-48d3-9168-17c133456f13-ca-trust-extracted\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678923 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678757    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-registry-certificates\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678923 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678766    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc516401-096a-48d3-9168-17c133456f13-registry-tls\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.678923 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.678793    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc516401-096a-48d3-9168-17c133456f13-trusted-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:30:58.877318 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.877293    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-58c644d5d5-v7qnl"]
Jul 16 17:30:58.885662 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.885642    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-58c644d5d5-v7qnl"]
Jul 16 17:30:58.981223 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:30:58.981195    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc516401-096a-48d3-9168-17c133456f13" path="/var/lib/kubelet/pods/fc516401-096a-48d3-9168-17c133456f13/volumes"
Jul 16 17:31:15.614627 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:15.614599    2577 generic.go:356] "Generic (PLEG): container finished" podID="49a0d014-8620-44af-9fe7-0c48ab148bd3" containerID="165a7d3d792ddb792f139a8aaf148edb75055cfb163eddc58575e0cbd42be92c" exitCode=0
Jul 16 17:31:15.614985 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:15.614669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm" event={"ID":"49a0d014-8620-44af-9fe7-0c48ab148bd3","Type":"ContainerDied","Data":"165a7d3d792ddb792f139a8aaf148edb75055cfb163eddc58575e0cbd42be92c"}
Jul 16 17:31:15.615045 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:15.615013    2577 scope.go:117] "RemoveContainer" containerID="165a7d3d792ddb792f139a8aaf148edb75055cfb163eddc58575e0cbd42be92c"
Jul 16 17:31:15.616182 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:15.616167    2577 generic.go:356] "Generic (PLEG): container finished" podID="5570d77d-a138-4451-a204-e3e69019603e" containerID="7a85c5c40c5fda61c0126e1b23bccf4be1e2663572575b902efab57961f31904" exitCode=0
Jul 16 17:31:15.616238 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:15.616220    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt" event={"ID":"5570d77d-a138-4451-a204-e3e69019603e","Type":"ContainerDied","Data":"7a85c5c40c5fda61c0126e1b23bccf4be1e2663572575b902efab57961f31904"}
Jul 16 17:31:15.616518 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:15.616505    2577 scope.go:117] "RemoveContainer" containerID="7a85c5c40c5fda61c0126e1b23bccf4be1e2663572575b902efab57961f31904"
Jul 16 17:31:16.622405 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:16.622373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-6kkjt" event={"ID":"5570d77d-a138-4451-a204-e3e69019603e","Type":"ContainerStarted","Data":"cee2a80c8ca4b3edff059cd820841425bf00404288797e6e943d678f7fe4f6e8"}
Jul 16 17:31:16.624180 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:31:16.624150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-99ncm" event={"ID":"49a0d014-8620-44af-9fe7-0c48ab148bd3","Type":"ContainerStarted","Data":"129d8a251a1f5808349e0000cd10955ff8a6a6fc6c0d2b5530c72ecf6cdb430e"}
Jul 16 17:33:40.903272 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:33:40.903237    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:33:40.908716 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:33:40.908685    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:33:40.910155 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:33:40.910127    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:33:40.914492 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:33:40.914469    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 17:33:40.916098 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:33:40.916077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:35:33.717284 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.717248    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"]
Jul 16 17:35:33.717703 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.717508    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc516401-096a-48d3-9168-17c133456f13" containerName="registry"
Jul 16 17:35:33.717703 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.717519    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc516401-096a-48d3-9168-17c133456f13" containerName="registry"
Jul 16 17:35:33.717703 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.717571    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc516401-096a-48d3-9168-17c133456f13" containerName="registry"
Jul 16 17:35:33.720263 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.720243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:33.724735 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.724711    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 16 17:35:33.724843 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.724794    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jwbg7\""
Jul 16 17:35:33.724895 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.724843    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:35:33.734841 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.734820    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"]
Jul 16 17:35:33.834012 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.833980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvhx7\" (UniqueName: \"kubernetes.io/projected/b2290e53-786b-43a8-8e93-11937c3cd667-kube-api-access-hvhx7\") pod \"cert-manager-operator-controller-manager-55c444bf86-6975z\" (UID: \"b2290e53-786b-43a8-8e93-11937c3cd667\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:33.834155 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.834058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2290e53-786b-43a8-8e93-11937c3cd667-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6975z\" (UID: \"b2290e53-786b-43a8-8e93-11937c3cd667\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:33.934582 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.934546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvhx7\" (UniqueName: \"kubernetes.io/projected/b2290e53-786b-43a8-8e93-11937c3cd667-kube-api-access-hvhx7\") pod \"cert-manager-operator-controller-manager-55c444bf86-6975z\" (UID: \"b2290e53-786b-43a8-8e93-11937c3cd667\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:33.934740 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.934624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2290e53-786b-43a8-8e93-11937c3cd667-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6975z\" (UID: \"b2290e53-786b-43a8-8e93-11937c3cd667\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:33.935037 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.935018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2290e53-786b-43a8-8e93-11937c3cd667-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6975z\" (UID: \"b2290e53-786b-43a8-8e93-11937c3cd667\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:33.944837 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:33.944813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvhx7\" (UniqueName: \"kubernetes.io/projected/b2290e53-786b-43a8-8e93-11937c3cd667-kube-api-access-hvhx7\") pod \"cert-manager-operator-controller-manager-55c444bf86-6975z\" (UID: \"b2290e53-786b-43a8-8e93-11937c3cd667\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:34.028931 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:34.028882    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"
Jul 16 17:35:34.174791 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:34.174762    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z"]
Jul 16 17:35:34.178438 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:35:34.178413    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2290e53_786b_43a8_8e93_11937c3cd667.slice/crio-83fa3f8e438f349d9f271cdcf3d8c1a2359c2060b047a5332002088aad9a62ca WatchSource:0}: Error finding container 83fa3f8e438f349d9f271cdcf3d8c1a2359c2060b047a5332002088aad9a62ca: Status 404 returned error can't find the container with id 83fa3f8e438f349d9f271cdcf3d8c1a2359c2060b047a5332002088aad9a62ca
Jul 16 17:35:34.180986 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:34.180972    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:35:34.506226 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:34.506143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z" event={"ID":"b2290e53-786b-43a8-8e93-11937c3cd667","Type":"ContainerStarted","Data":"83fa3f8e438f349d9f271cdcf3d8c1a2359c2060b047a5332002088aad9a62ca"}
Jul 16 17:35:37.522461 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:37.522424    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z" event={"ID":"b2290e53-786b-43a8-8e93-11937c3cd667","Type":"ContainerStarted","Data":"2c590dff2f99f61ca0bbe7b157c4b62d7a6159120a8fb76fab0616a2637e2abb"}
Jul 16 17:35:37.561736 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:37.561686    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6975z" podStartSLOduration=1.738184681 podStartE2EDuration="4.561668686s" totalImagesPullingTime="2.823484005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:37.559652369 +0000 UTC m=+417.076250287" watchObservedRunningTime="2026-07-16 17:35:37.561668686 +0000 UTC m=+417.078266604"
Jul 16 17:35:50.283992 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.283958    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"]
Jul 16 17:35:50.290201 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.290184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.293477 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.293458    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:35:50.294826 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.294811    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 16 17:35:50.297595 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.297578    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9g9cp\""
Jul 16 17:35:50.320178 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.320146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"]
Jul 16 17:35:50.360905 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.360874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzb2t\" (UniqueName: \"kubernetes.io/projected/22172724-1f7b-465e-ac8c-adf306196a06-kube-api-access-tzb2t\") pod \"openshift-lws-operator-fd8ccff4c-qd5fp\" (UID: \"22172724-1f7b-465e-ac8c-adf306196a06\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.360905 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.360909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22172724-1f7b-465e-ac8c-adf306196a06-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qd5fp\" (UID: \"22172724-1f7b-465e-ac8c-adf306196a06\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.461754 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.461719    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzb2t\" (UniqueName: \"kubernetes.io/projected/22172724-1f7b-465e-ac8c-adf306196a06-kube-api-access-tzb2t\") pod \"openshift-lws-operator-fd8ccff4c-qd5fp\" (UID: \"22172724-1f7b-465e-ac8c-adf306196a06\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.461754 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.461756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22172724-1f7b-465e-ac8c-adf306196a06-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qd5fp\" (UID: \"22172724-1f7b-465e-ac8c-adf306196a06\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.462200 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.462169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22172724-1f7b-465e-ac8c-adf306196a06-tmp\") pod \"openshift-lws-operator-fd8ccff4c-qd5fp\" (UID: \"22172724-1f7b-465e-ac8c-adf306196a06\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.474875 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.474838    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzb2t\" (UniqueName: \"kubernetes.io/projected/22172724-1f7b-465e-ac8c-adf306196a06-kube-api-access-tzb2t\") pod \"openshift-lws-operator-fd8ccff4c-qd5fp\" (UID: \"22172724-1f7b-465e-ac8c-adf306196a06\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.598711 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.598632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"
Jul 16 17:35:50.757884 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:50.757852    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp"]
Jul 16 17:35:50.762755 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:35:50.762723    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22172724_1f7b_465e_ac8c_adf306196a06.slice/crio-520b8aca8239845743fbc1ab6106ad21ba9587a182ab22ef33a3515923c0cf43 WatchSource:0}: Error finding container 520b8aca8239845743fbc1ab6106ad21ba9587a182ab22ef33a3515923c0cf43: Status 404 returned error can't find the container with id 520b8aca8239845743fbc1ab6106ad21ba9587a182ab22ef33a3515923c0cf43
Jul 16 17:35:51.576608 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:51.576571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp" event={"ID":"22172724-1f7b-465e-ac8c-adf306196a06","Type":"ContainerStarted","Data":"520b8aca8239845743fbc1ab6106ad21ba9587a182ab22ef33a3515923c0cf43"}
Jul 16 17:35:53.592116 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:53.592074    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp" event={"ID":"22172724-1f7b-465e-ac8c-adf306196a06","Type":"ContainerStarted","Data":"d3f2721bef0a360a361696816c1a9daab98d37d9e08fe4bbe99a0a553f84b7d2"}
Jul 16 17:35:53.618101 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:35:53.618056    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-qd5fp" podStartSLOduration=1.136496931 podStartE2EDuration="3.61804377s" totalImagesPullingTime="2.481546839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:53.61757811 +0000 UTC m=+433.134176030" watchObservedRunningTime="2026-07-16 17:35:53.61804377 +0000 UTC m=+433.134641688"
Jul 16 17:36:09.559708 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.559628    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"]
Jul 16 17:36:09.562867 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.562847    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.565259 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.565239    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 17:36:09.566186 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.566170    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gfh6s\""
Jul 16 17:36:09.566346 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.566306    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 17:36:09.566453 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.566433    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 17:36:09.566573 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.566513    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 17:36:09.601683 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.601651    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"]
Jul 16 17:36:09.704107 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.704067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56ckv\" (UniqueName: \"kubernetes.io/projected/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-kube-api-access-56ckv\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.704107 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.704109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.704313 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.704189    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-tmp\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.704313 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.704220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.704313 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.704252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-manifests\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.805162 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.805127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-manifests\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.805351 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.805181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56ckv\" (UniqueName: \"kubernetes.io/projected/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-kube-api-access-56ckv\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.805351 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.805202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.805351 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.805234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-tmp\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.805351 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.805249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.805615 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.805590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-manifests\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.807596 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.807573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-tmp\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.807714 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.807672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.807714 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.807695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-webhook-cert\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.821625 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.821559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56ckv\" (UniqueName: \"kubernetes.io/projected/af1f70fa-05b5-4c80-85a6-ff22aba7eeb3-kube-api-access-56ckv\") pod \"opendatahub-operator-controller-manager-586f4b4fcb-q6d7n\" (UID: \"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3\") " pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:09.873579 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:09.873538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:10.021869 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:10.021836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"]
Jul 16 17:36:10.025539 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:36:10.025511    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1f70fa_05b5_4c80_85a6_ff22aba7eeb3.slice/crio-364ac11c772b15ac8a90c3b407ae3f99704ee650e07a35540507067d6eb2ad29 WatchSource:0}: Error finding container 364ac11c772b15ac8a90c3b407ae3f99704ee650e07a35540507067d6eb2ad29: Status 404 returned error can't find the container with id 364ac11c772b15ac8a90c3b407ae3f99704ee650e07a35540507067d6eb2ad29
Jul 16 17:36:10.663545 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:10.663508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n" event={"ID":"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3","Type":"ContainerStarted","Data":"364ac11c772b15ac8a90c3b407ae3f99704ee650e07a35540507067d6eb2ad29"}
Jul 16 17:36:13.679661 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:13.679622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n" event={"ID":"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3","Type":"ContainerStarted","Data":"e71a8d9006e42547eb7e9b9b7469aa7b644d33a5bdea4d5a1da121391eb478db"}
Jul 16 17:36:14.684993 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:14.684956    2577 generic.go:356] "Generic (PLEG): container finished" podID="af1f70fa-05b5-4c80-85a6-ff22aba7eeb3" containerID="e71a8d9006e42547eb7e9b9b7469aa7b644d33a5bdea4d5a1da121391eb478db" exitCode=0
Jul 16 17:36:14.685502 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:14.685032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n" event={"ID":"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3","Type":"ContainerDied","Data":"e71a8d9006e42547eb7e9b9b7469aa7b644d33a5bdea4d5a1da121391eb478db"}
Jul 16 17:36:15.690660 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:15.690622    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n" event={"ID":"af1f70fa-05b5-4c80-85a6-ff22aba7eeb3","Type":"ContainerStarted","Data":"c7531532d16b06f0c7941342ff7566118a94f6eea00ffa2df7bfed08370bb690"}
Jul 16 17:36:15.691033 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:15.690755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:15.724066 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:15.724021    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n" podStartSLOduration=2.214422502 podStartE2EDuration="6.724009564s" totalImagesPullingTime="3.45905194s" totalInitContainerRuntime="1.050535122s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:15.722506779 +0000 UTC m=+455.239104727" watchObservedRunningTime="2026-07-16 17:36:15.724009564 +0000 UTC m=+455.240607482"
Jul 16 17:36:26.697505 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:26.697468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-586f4b4fcb-q6d7n"
Jul 16 17:36:29.340454 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.340420    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"]
Jul 16 17:36:29.357611 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.357582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.364621 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.364593    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 16 17:36:29.364797 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.364777    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 16 17:36:29.365097 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.364593    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-cfdd5\""
Jul 16 17:36:29.365097 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.364917    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 16 17:36:29.374483 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.374458    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"]
Jul 16 17:36:29.447040 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.447001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8krz7\" (UniqueName: \"kubernetes.io/projected/8e53ac5c-a837-4523-a295-36b9526bdecc-kube-api-access-8krz7\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.447221 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.447054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e53ac5c-a837-4523-a295-36b9526bdecc-cert\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.447221 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.447115    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e53ac5c-a837-4523-a295-36b9526bdecc-metrics-cert\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.447221 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.447149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e53ac5c-a837-4523-a295-36b9526bdecc-manager-config\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.548438 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.548399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e53ac5c-a837-4523-a295-36b9526bdecc-metrics-cert\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.548438 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.548437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e53ac5c-a837-4523-a295-36b9526bdecc-manager-config\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.548654 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.548492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8krz7\" (UniqueName: \"kubernetes.io/projected/8e53ac5c-a837-4523-a295-36b9526bdecc-kube-api-access-8krz7\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.548654 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.548546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e53ac5c-a837-4523-a295-36b9526bdecc-cert\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.549428 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.549401    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8e53ac5c-a837-4523-a295-36b9526bdecc-manager-config\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.551226 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.551200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8e53ac5c-a837-4523-a295-36b9526bdecc-metrics-cert\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.551524 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.551502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8e53ac5c-a837-4523-a295-36b9526bdecc-cert\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.565769 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.565744    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8krz7\" (UniqueName: \"kubernetes.io/projected/8e53ac5c-a837-4523-a295-36b9526bdecc-kube-api-access-8krz7\") pod \"lws-controller-manager-55f946f648-r22jc\" (UID: \"8e53ac5c-a837-4523-a295-36b9526bdecc\") " pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.669134 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.669057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:29.806584 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:29.806556    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"]
Jul 16 17:36:29.809053 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:36:29.809021    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e53ac5c_a837_4523_a295_36b9526bdecc.slice/crio-a7f1f06d453532250d579300b41217a5615edddd99e5594f807e334ebd4cbfca WatchSource:0}: Error finding container a7f1f06d453532250d579300b41217a5615edddd99e5594f807e334ebd4cbfca: Status 404 returned error can't find the container with id a7f1f06d453532250d579300b41217a5615edddd99e5594f807e334ebd4cbfca
Jul 16 17:36:30.757354 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:30.756899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc" event={"ID":"8e53ac5c-a837-4523-a295-36b9526bdecc","Type":"ContainerStarted","Data":"a7f1f06d453532250d579300b41217a5615edddd99e5594f807e334ebd4cbfca"}
Jul 16 17:36:31.765602 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:31.765497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc" event={"ID":"8e53ac5c-a837-4523-a295-36b9526bdecc","Type":"ContainerStarted","Data":"58dcfeb46ba3e2d7425d837703dbb42da1e24d04fcc7ee98352d7d74aa9d9f0e"}
Jul 16 17:36:31.766348 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:31.766311    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:36:31.802258 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:31.802215    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc" podStartSLOduration=1.108751889 podStartE2EDuration="2.802202167s" totalImagesPullingTime="1.693450278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:31.799879959 +0000 UTC m=+471.316477897" watchObservedRunningTime="2026-07-16 17:36:31.802202167 +0000 UTC m=+471.318800084"
Jul 16 17:36:37.660383 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.660349    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"]
Jul 16 17:36:37.663568 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.663545    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.665828 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.665805    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 17:36:37.665951 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.665891    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 17:36:37.666131 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.666114    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 17:36:37.666185 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.666147    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 17:36:37.666185 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.666154    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 17:36:37.666462 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.666447    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-l4zzw\""
Jul 16 17:36:37.666462 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.666455    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 17:36:37.678439 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.678418    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"]
Jul 16 17:36:37.712505 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712477    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.712633 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.712633 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.712633 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712605    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.712633 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgwhw\" (UniqueName: \"kubernetes.io/projected/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-kube-api-access-hgwhw\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.712832 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.712832 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.712692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.813928 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.813897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.813928 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.813931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.814174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.813953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.814174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.813982    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.814174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.814005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgwhw\" (UniqueName: \"kubernetes.io/projected/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-kube-api-access-hgwhw\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.814174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.814022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.814174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.814056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.814650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.814621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.816539 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.816510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.816646 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.816510    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.816733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.816713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.816790 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.816719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.825097 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.825072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.825443 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.825424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgwhw\" (UniqueName: \"kubernetes.io/projected/dae69b9d-3503-4e8a-96b9-bc9f4cefaaea-kube-api-access-hgwhw\") pod \"istiod-openshift-gateway-94bb8fbfd-qwfrj\" (UID: \"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:37.973222 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:37.973140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:38.107679 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:38.107654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"]
Jul 16 17:36:38.110995 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:36:38.110962    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddae69b9d_3503_4e8a_96b9_bc9f4cefaaea.slice/crio-a663c540c14692d1107482a1700df9c14a8a00ac67f0c5e2943bb1c6b3fc3765 WatchSource:0}: Error finding container a663c540c14692d1107482a1700df9c14a8a00ac67f0c5e2943bb1c6b3fc3765: Status 404 returned error can't find the container with id a663c540c14692d1107482a1700df9c14a8a00ac67f0c5e2943bb1c6b3fc3765
Jul 16 17:36:38.795487 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:38.795453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj" event={"ID":"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea","Type":"ContainerStarted","Data":"a663c540c14692d1107482a1700df9c14a8a00ac67f0c5e2943bb1c6b3fc3765"}
Jul 16 17:36:41.764933 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:41.764890    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:36:41.765321 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:41.765004    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 17:36:42.815549 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:42.815510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj" event={"ID":"dae69b9d-3503-4e8a-96b9-bc9f4cefaaea","Type":"ContainerStarted","Data":"ffb8b751e7dbcc4f4df15f431d648aaf0de026dd8f882300efdd74cb77867917"}
Jul 16 17:36:42.815940 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:42.815692    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:42.817471 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:42.817449    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj"
Jul 16 17:36:42.845396 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:42.845347    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qwfrj" podStartSLOduration=2.193446092 podStartE2EDuration="5.845312215s" totalImagesPullingTime="3.651866123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:36:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:36:42.842737502 +0000 UTC m=+482.359335420" watchObservedRunningTime="2026-07-16 17:36:42.845312215 +0000 UTC m=+482.361910133"
Jul 16 17:36:43.777323 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:36:43.777292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55f946f648-r22jc"
Jul 16 17:38:40.933393 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:38:40.933358    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:38:40.937205 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:38:40.937184    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:38:40.939982 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:38:40.939958    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:38:40.943985 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:38:40.943969    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:39:23.420650 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.420612    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:39:23.423678 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.423658    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.426490 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.426465    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 17:39:23.426618 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.426472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 17:39:23.427265 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.427246    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 17:39:23.427265 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.427258    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2tmqz\""
Jul 16 17:39:23.434540 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.434518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:39:23.448276 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.448254    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:39:23.528902 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.528868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/01d5540f-77a8-448d-93f6-184574c49015-config-file\") pod \"limitador-limitador-54d6d988d5-562t9\" (UID: \"01d5540f-77a8-448d-93f6-184574c49015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.529046 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.528906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cttk\" (UniqueName: \"kubernetes.io/projected/01d5540f-77a8-448d-93f6-184574c49015-kube-api-access-7cttk\") pod \"limitador-limitador-54d6d988d5-562t9\" (UID: \"01d5540f-77a8-448d-93f6-184574c49015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.630107 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.630073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/01d5540f-77a8-448d-93f6-184574c49015-config-file\") pod \"limitador-limitador-54d6d988d5-562t9\" (UID: \"01d5540f-77a8-448d-93f6-184574c49015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.630107 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.630111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cttk\" (UniqueName: \"kubernetes.io/projected/01d5540f-77a8-448d-93f6-184574c49015-kube-api-access-7cttk\") pod \"limitador-limitador-54d6d988d5-562t9\" (UID: \"01d5540f-77a8-448d-93f6-184574c49015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.630753 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.630731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/01d5540f-77a8-448d-93f6-184574c49015-config-file\") pod \"limitador-limitador-54d6d988d5-562t9\" (UID: \"01d5540f-77a8-448d-93f6-184574c49015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.640323 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.640300    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cttk\" (UniqueName: \"kubernetes.io/projected/01d5540f-77a8-448d-93f6-184574c49015-kube-api-access-7cttk\") pod \"limitador-limitador-54d6d988d5-562t9\" (UID: \"01d5540f-77a8-448d-93f6-184574c49015\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.734209 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.734141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:23.866802 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:23.866771    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:39:23.870023 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:39:23.869992    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01d5540f_77a8_448d_93f6_184574c49015.slice/crio-b8530c05277d12d12883cfa660e7ba44ff08503172f5a809b5d4c0b3bea6e897 WatchSource:0}: Error finding container b8530c05277d12d12883cfa660e7ba44ff08503172f5a809b5d4c0b3bea6e897: Status 404 returned error can't find the container with id b8530c05277d12d12883cfa660e7ba44ff08503172f5a809b5d4c0b3bea6e897
Jul 16 17:39:24.482382 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:24.482344    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9" event={"ID":"01d5540f-77a8-448d-93f6-184574c49015","Type":"ContainerStarted","Data":"b8530c05277d12d12883cfa660e7ba44ff08503172f5a809b5d4c0b3bea6e897"}
Jul 16 17:39:26.492673 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:26.492641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9" event={"ID":"01d5540f-77a8-448d-93f6-184574c49015","Type":"ContainerStarted","Data":"53a6397ff37d4dd3e8620637f20ba0684632c2fd08564c413265f03bd871e04d"}
Jul 16 17:39:26.493046 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:26.492776    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:39:26.510973 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:26.510764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9" podStartSLOduration=1.053394664 podStartE2EDuration="3.51074487s" totalImagesPullingTime="2.457350206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:39:26.510485279 +0000 UTC m=+646.027083198" watchObservedRunningTime="2026-07-16 17:39:26.51074487 +0000 UTC m=+646.027342792"
Jul 16 17:39:37.498546 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:39:37.498517    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-562t9"
Jul 16 17:40:39.745464 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:40:39.745385    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:41:07.341768 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:07.341731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:41:16.943432 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.943401    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"]
Jul 16 17:41:16.946680 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.946661    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:16.951034 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.951013    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 16 17:41:16.951148 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.951018    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 16 17:41:16.955891 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.955866    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jzc82\""
Jul 16 17:41:16.956343 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.956311    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 16 17:41:16.971023 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:16.971000    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"]
Jul 16 17:41:17.031080 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.031048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.031080 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.031077    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.031298 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.031103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.031298 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.031201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.031406 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.031290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk797\" (UniqueName: \"kubernetes.io/projected/6ba0c706-09fc-452c-b761-2345d34216d5-kube-api-access-jk797\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.031406 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.031358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ba0c706-09fc-452c-b761-2345d34216d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132341 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132507 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132380    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132507 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk797\" (UniqueName: \"kubernetes.io/projected/6ba0c706-09fc-452c-b761-2345d34216d5-kube-api-access-jk797\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132507 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ba0c706-09fc-452c-b761-2345d34216d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132507 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132507 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132773 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132830 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.132830 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.132794    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.134735 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.134714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ba0c706-09fc-452c-b761-2345d34216d5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.134887 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.134865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ba0c706-09fc-452c-b761-2345d34216d5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.166806 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.166778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk797\" (UniqueName: \"kubernetes.io/projected/6ba0c706-09fc-452c-b761-2345d34216d5-kube-api-access-jk797\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mwmnp\" (UID: \"6ba0c706-09fc-452c-b761-2345d34216d5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.257054 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.256956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:17.398359 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.398234    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"]
Jul 16 17:41:17.400960 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:41:17.400930    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba0c706_09fc_452c_b761_2345d34216d5.slice/crio-3b4cce1905e40bea25d05a89ff04745e58ebd05bc52928e8ecbdd0a8018c36fa WatchSource:0}: Error finding container 3b4cce1905e40bea25d05a89ff04745e58ebd05bc52928e8ecbdd0a8018c36fa: Status 404 returned error can't find the container with id 3b4cce1905e40bea25d05a89ff04745e58ebd05bc52928e8ecbdd0a8018c36fa
Jul 16 17:41:17.402273 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.402251    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:41:17.966510 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:17.966471    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp" event={"ID":"6ba0c706-09fc-452c-b761-2345d34216d5","Type":"ContainerStarted","Data":"3b4cce1905e40bea25d05a89ff04745e58ebd05bc52928e8ecbdd0a8018c36fa"}
Jul 16 17:41:18.047865 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:18.047819    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:41:18.975183 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:18.975146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp" event={"ID":"6ba0c706-09fc-452c-b761-2345d34216d5","Type":"ContainerStarted","Data":"b16bf3b24023fec8ada82354755407d39dac7f5d333572cf6bd378953db21d22"}
Jul 16 17:41:18.996720 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:18.996672    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp" podStartSLOduration=1.963585301 podStartE2EDuration="2.996653772s" totalImagesPullingTime="1.033068471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:18.995718233 +0000 UTC m=+758.512316174" watchObservedRunningTime="2026-07-16 17:41:18.996653772 +0000 UTC m=+758.513251689"
Jul 16 17:41:27.258006 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:27.257955    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:27.258444 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:27.258038    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:27.270660 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:27.270627    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:28.023030 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:28.022994    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mwmnp"
Jul 16 17:41:30.125821 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:30.125779    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:41:34.907496 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:41:34.907459    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:42:06.949707 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:42:06.949614    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:42:15.968875 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:42:15.968842    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:43:40.961623 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:43:40.961491    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:43:40.962131 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:43:40.961962    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:43:40.968387 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:43:40.968368    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:43:40.968917 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:43:40.968896    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:43:49.865670 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:43:49.865633    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:43:59.965578 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:43:59.965545    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:44:09.795289 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:44:09.795256    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:45:51.859239 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:45:51.859199    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:46:00.769035 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:46:00.768991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:46:33.984111 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:46:33.984033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:46:43.249379 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:46:43.249346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:46:55.655915 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:46:55.655884    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:47:06.047274 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:47:06.047238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:47:15.148220 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:47:15.148183    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:47:24.955656 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:47:24.955621    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:47:36.149877 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:47:36.149839    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:47:46.151077 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:47:46.151044    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:48:11.657114 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:11.657018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:48:22.453174 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:22.453139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:48:40.986094 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:40.986060    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:48:40.987502 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:40.987475    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:48:40.992601 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:40.992576    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:48:40.993549 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:40.993529    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:48:46.861091 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:46.861059    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:48:57.948090 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:48:57.948057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:49:15.556362 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:49:15.556308    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:49:25.089078 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:49:25.089047    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:49:36.254796 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:49:36.254717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:49:45.954784 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:49:45.954743    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:49:55.860812 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:49:55.860775    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:51:43.373654 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:51:43.373564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:51:55.465857 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:51:55.465825    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:52:04.845615 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:52:04.845578    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:52:16.075673 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:52:16.075639    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:52:27.453429 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:52:27.453386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:52:38.771049 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:52:38.770977    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:52:46.562243 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:52:46.562208    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:52:57.945588 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:52:57.945542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:53:09.853176 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:09.853142    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:53:18.752621 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:18.752586    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:53:32.997501 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:32.997467    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:53:41.009255 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:41.009224    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:53:41.011011 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:41.010988    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:53:41.015632 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:41.015614    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:53:41.022968 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:41.022947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:53:55.996862 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:53:55.996823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:54:03.063804 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:54:03.063764    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:54:13.560608 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:54:13.560573    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:54:25.351491 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:54:25.351453    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:54:43.659505 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:54:43.659467    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:54:53.978070 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:54:53.978033    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:55:03.753129 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:55:03.753093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:55:14.453313 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:55:14.453277    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:55:24.056837 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:55:24.056798    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:55:35.369579 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:55:35.369541    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:55:51.267639 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:55:51.267603    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:56:05.801883 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:56:05.801849    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:56:18.374405 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:56:18.374369    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:56:29.876399 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:56:29.876365    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:56:42.450461 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:56:42.450426    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:56:55.152641 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:56:55.152598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:57:07.391626 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:57:07.391541    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:57:21.508509 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:57:21.508471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:57:33.674184 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:57:33.674146    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:57:47.952919 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:57:47.952882    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:58:01.198695 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:01.198657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:58:02.252308 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.252272    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"]
Jul 16 17:58:02.255639 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.255618    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:02.258053 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.258036    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 17:58:02.258199 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.258181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 17:58:02.263837 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.263814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"]
Jul 16 17:58:02.385150 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.385102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da4713d-6c17-4f1f-b3bf-e904e994a4e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn\" (UID: \"2da4713d-6c17-4f1f-b3bf-e904e994a4e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:02.485818 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.485780    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da4713d-6c17-4f1f-b3bf-e904e994a4e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn\" (UID: \"2da4713d-6c17-4f1f-b3bf-e904e994a4e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:02.486422 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.486402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da4713d-6c17-4f1f-b3bf-e904e994a4e0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn\" (UID: \"2da4713d-6c17-4f1f-b3bf-e904e994a4e0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:02.566428 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.566393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:02.697616 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.697591    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"]
Jul 16 17:58:02.700003 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:58:02.699976    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2da4713d_6c17_4f1f_b3bf_e904e994a4e0.slice/crio-e40c55893fa19fe4b2d091c2eaf4558d0c0fe1d7fe9e8a487c386c4dd57d7205 WatchSource:0}: Error finding container e40c55893fa19fe4b2d091c2eaf4558d0c0fe1d7fe9e8a487c386c4dd57d7205: Status 404 returned error can't find the container with id e40c55893fa19fe4b2d091c2eaf4558d0c0fe1d7fe9e8a487c386c4dd57d7205
Jul 16 17:58:02.701750 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:02.701734    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:58:03.104866 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:03.104830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn" event={"ID":"2da4713d-6c17-4f1f-b3bf-e904e994a4e0","Type":"ContainerStarted","Data":"e40c55893fa19fe4b2d091c2eaf4558d0c0fe1d7fe9e8a487c386c4dd57d7205"}
Jul 16 17:58:05.114668 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:05.114566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn" event={"ID":"2da4713d-6c17-4f1f-b3bf-e904e994a4e0","Type":"ContainerStarted","Data":"370d89adb415928842208300e6676358362055a71b5b5fe9ba40b38f32a32342"}
Jul 16 17:58:05.133608 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:05.133547    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn" podStartSLOduration=0.979827813 podStartE2EDuration="3.13352788s" totalImagesPullingTime="2.153700067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:58:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:58:05.132422484 +0000 UTC m=+1764.649020413" watchObservedRunningTime="2026-07-16 17:58:05.13352788 +0000 UTC m=+1764.650125798"
Jul 16 17:58:06.119815 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:06.119771    2577 generic.go:356] "Generic (PLEG): container finished" podID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerID="370d89adb415928842208300e6676358362055a71b5b5fe9ba40b38f32a32342" exitCode=7
Jul 16 17:58:06.120244 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:06.119857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn" event={"ID":"2da4713d-6c17-4f1f-b3bf-e904e994a4e0","Type":"ContainerDied","Data":"370d89adb415928842208300e6676358362055a71b5b5fe9ba40b38f32a32342"}
Jul 16 17:58:06.120244 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:06.119995    2577 scope.go:117] "RemoveContainer" containerID="370d89adb415928842208300e6676358362055a71b5b5fe9ba40b38f32a32342"
Jul 16 17:58:07.125527 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:07.125494    2577 generic.go:356] "Generic (PLEG): container finished" podID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerID="8dc0279b8046a1f2a9ed083ef65852d09ce59f06125cec93806b4fbe0e200793" exitCode=0
Jul 16 17:58:07.125977 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:07.125551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn" event={"ID":"2da4713d-6c17-4f1f-b3bf-e904e994a4e0","Type":"ContainerDied","Data":"8dc0279b8046a1f2a9ed083ef65852d09ce59f06125cec93806b4fbe0e200793"}
Jul 16 17:58:07.125977 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:07.125595    2577 scope.go:117] "RemoveContainer" containerID="370d89adb415928842208300e6676358362055a71b5b5fe9ba40b38f32a32342"
Jul 16 17:58:08.254769 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:08.254742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:08.335515 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:08.335485    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da4713d-6c17-4f1f-b3bf-e904e994a4e0-maas-api-service-ca\") pod \"2da4713d-6c17-4f1f-b3bf-e904e994a4e0\" (UID: \"2da4713d-6c17-4f1f-b3bf-e904e994a4e0\") "
Jul 16 17:58:08.335847 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:08.335824    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2da4713d-6c17-4f1f-b3bf-e904e994a4e0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2da4713d-6c17-4f1f-b3bf-e904e994a4e0" (UID: "2da4713d-6c17-4f1f-b3bf-e904e994a4e0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:58:08.436424 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:08.436338    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2da4713d-6c17-4f1f-b3bf-e904e994a4e0-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:58:09.137223 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:09.137193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn" event={"ID":"2da4713d-6c17-4f1f-b3bf-e904e994a4e0","Type":"ContainerDied","Data":"e40c55893fa19fe4b2d091c2eaf4558d0c0fe1d7fe9e8a487c386c4dd57d7205"}
Jul 16 17:58:09.137223 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:09.137209    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn"
Jul 16 17:58:09.137453 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:09.137245    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e40c55893fa19fe4b2d091c2eaf4558d0c0fe1d7fe9e8a487c386c4dd57d7205"
Jul 16 17:58:18.280691 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:18.280654    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:58:31.861396 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861361    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"]
Jul 16 17:58:31.861918 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861837    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerName="revoke-keys"
Jul 16 17:58:31.861918 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861858    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerName="revoke-keys"
Jul 16 17:58:31.861918 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861882    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerName="revoke-keys"
Jul 16 17:58:31.861918 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861890    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerName="revoke-keys"
Jul 16 17:58:31.862117 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861975    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerName="revoke-keys"
Jul 16 17:58:31.862117 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.861992    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2da4713d-6c17-4f1f-b3bf-e904e994a4e0" containerName="revoke-keys"
Jul 16 17:58:31.868141 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.868116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:31.870996 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.870965    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 17:58:31.871415 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.871396    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 17:58:31.872483 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.872456    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"]
Jul 16 17:58:31.923367 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:31.923309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh\" (UID: \"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:32.024777 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:32.024738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh\" (UID: \"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:32.025384 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:32.025366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh\" (UID: \"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:32.180881 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:32.180786    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:32.313934 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:32.313901    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"]
Jul 16 17:58:32.316852 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:58:32.316827    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4acf4b1_43d5_4c01_b1e5_31e0fa87f1f9.slice/crio-7db2d1afd0f4ddcbfdc6b5c30c2764b9485769eb2cde49083827b86546e60635 WatchSource:0}: Error finding container 7db2d1afd0f4ddcbfdc6b5c30c2764b9485769eb2cde49083827b86546e60635: Status 404 returned error can't find the container with id 7db2d1afd0f4ddcbfdc6b5c30c2764b9485769eb2cde49083827b86546e60635
Jul 16 17:58:33.237158 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:33.237062    2577 generic.go:356] "Generic (PLEG): container finished" podID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerID="61607cc65b5cb653f7d6f452bce51b435e3050669e1344650c62856a4a543d46" exitCode=7
Jul 16 17:58:33.237158 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:33.237147    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" event={"ID":"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9","Type":"ContainerDied","Data":"61607cc65b5cb653f7d6f452bce51b435e3050669e1344650c62856a4a543d46"}
Jul 16 17:58:33.237751 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:33.237198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" event={"ID":"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9","Type":"ContainerStarted","Data":"7db2d1afd0f4ddcbfdc6b5c30c2764b9485769eb2cde49083827b86546e60635"}
Jul 16 17:58:33.237751 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:33.237310    2577 scope.go:117] "RemoveContainer" containerID="61607cc65b5cb653f7d6f452bce51b435e3050669e1344650c62856a4a543d46"
Jul 16 17:58:34.243623 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:34.243529    2577 generic.go:356] "Generic (PLEG): container finished" podID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerID="177ebe21765239b287ca9d9e28045cdbf515c13d0b8d9405f7a19881d59322bc" exitCode=7
Jul 16 17:58:34.243623 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:34.243616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" event={"ID":"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9","Type":"ContainerDied","Data":"177ebe21765239b287ca9d9e28045cdbf515c13d0b8d9405f7a19881d59322bc"}
Jul 16 17:58:34.244059 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:34.243666    2577 scope.go:117] "RemoveContainer" containerID="61607cc65b5cb653f7d6f452bce51b435e3050669e1344650c62856a4a543d46"
Jul 16 17:58:34.244059 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:34.243782    2577 scope.go:117] "RemoveContainer" containerID="177ebe21765239b287ca9d9e28045cdbf515c13d0b8d9405f7a19881d59322bc"
Jul 16 17:58:34.244059 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:58:34.244020    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh_odh-ai-gateway-infra(e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9"
Jul 16 17:58:35.249577 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:35.249549    2577 scope.go:117] "RemoveContainer" containerID="177ebe21765239b287ca9d9e28045cdbf515c13d0b8d9405f7a19881d59322bc"
Jul 16 17:58:35.249963 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:58:35.249729    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh_odh-ai-gateway-infra(e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9"
Jul 16 17:58:36.099024 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:36.098992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:58:41.045822 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:41.045791    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:58:41.047623 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:41.047599    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 17:58:41.052024 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:41.052005    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:58:41.053986 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:41.053968    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 17:58:47.976836 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:47.976804    2577 scope.go:117] "RemoveContainer" containerID="177ebe21765239b287ca9d9e28045cdbf515c13d0b8d9405f7a19881d59322bc"
Jul 16 17:58:48.306598 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:48.306571    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" event={"ID":"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9","Type":"ContainerStarted","Data":"f554a10fabc2a3bbc7bc85f927f38404da9cfc3e6b5431fa1cf15bd828bdf0ba"}
Jul 16 17:58:49.312234 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:49.312203    2577 generic.go:356] "Generic (PLEG): container finished" podID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerID="f554a10fabc2a3bbc7bc85f927f38404da9cfc3e6b5431fa1cf15bd828bdf0ba" exitCode=0
Jul 16 17:58:49.312582 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:49.312252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" event={"ID":"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9","Type":"ContainerDied","Data":"f554a10fabc2a3bbc7bc85f927f38404da9cfc3e6b5431fa1cf15bd828bdf0ba"}
Jul 16 17:58:49.312582 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:49.312303    2577 scope.go:117] "RemoveContainer" containerID="177ebe21765239b287ca9d9e28045cdbf515c13d0b8d9405f7a19881d59322bc"
Jul 16 17:58:49.353555 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:49.353529    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"]
Jul 16 17:58:50.456392 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:50.456367    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:50.574976 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:50.574885    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9-maas-api-service-ca\") pod \"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9\" (UID: \"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9\") "
Jul 16 17:58:50.575298 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:50.575265    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" (UID: "e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:58:50.675727 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:50.675699    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:58:51.325844 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:51.325821    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"
Jul 16 17:58:51.326014 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:51.325860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh" event={"ID":"e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9","Type":"ContainerDied","Data":"7db2d1afd0f4ddcbfdc6b5c30c2764b9485769eb2cde49083827b86546e60635"}
Jul 16 17:58:51.326014 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:51.325903    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7db2d1afd0f4ddcbfdc6b5c30c2764b9485769eb2cde49083827b86546e60635"
Jul 16 17:58:51.379718 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:51.379691    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"]
Jul 16 17:58:51.385959 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:51.385939    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-85csh"]
Jul 16 17:58:52.982431 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:58:52.982403    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" path="/var/lib/kubelet/pods/e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9/volumes"
Jul 16 17:59:21.942344 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942288    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"]
Jul 16 17:59:21.942763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942652    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:21.942763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942665    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:21.942763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942676    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:21.942763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942682    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:21.942763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942748    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:21.942763 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.942758    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:21.949865 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.949835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:21.952433 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.952409    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 17:59:21.952552 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.952412    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 17:59:21.959029 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:21.959004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"]
Jul 16 17:59:22.042828 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:22.042793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c53f1d-5117-4577-813c-d14edc8c599d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf\" (UID: \"97c53f1d-5117-4577-813c-d14edc8c599d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:22.144003 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:22.143974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c53f1d-5117-4577-813c-d14edc8c599d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf\" (UID: \"97c53f1d-5117-4577-813c-d14edc8c599d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:22.144573 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:22.144555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c53f1d-5117-4577-813c-d14edc8c599d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf\" (UID: \"97c53f1d-5117-4577-813c-d14edc8c599d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:22.260993 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:22.260970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:22.397780 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:22.397750    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"]
Jul 16 17:59:22.401000 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:59:22.400974    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c53f1d_5117_4577_813c_d14edc8c599d.slice/crio-2e83c85d5a4822d179783851cd19f2507a381310c88af8e3a2c74531c530c3b7 WatchSource:0}: Error finding container 2e83c85d5a4822d179783851cd19f2507a381310c88af8e3a2c74531c530c3b7: Status 404 returned error can't find the container with id 2e83c85d5a4822d179783851cd19f2507a381310c88af8e3a2c74531c530c3b7
Jul 16 17:59:22.457261 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:22.457230    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf" event={"ID":"97c53f1d-5117-4577-813c-d14edc8c599d","Type":"ContainerStarted","Data":"2e83c85d5a4822d179783851cd19f2507a381310c88af8e3a2c74531c530c3b7"}
Jul 16 17:59:23.462565 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:23.462473    2577 generic.go:356] "Generic (PLEG): container finished" podID="97c53f1d-5117-4577-813c-d14edc8c599d" containerID="a4a3a27a921f72444764610aac8b443f16918133402f2c088da804ed9b258dd8" exitCode=0
Jul 16 17:59:23.462948 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:23.462563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf" event={"ID":"97c53f1d-5117-4577-813c-d14edc8c599d","Type":"ContainerDied","Data":"a4a3a27a921f72444764610aac8b443f16918133402f2c088da804ed9b258dd8"}
Jul 16 17:59:24.598062 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:24.598039    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:24.661302 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:24.661271    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c53f1d-5117-4577-813c-d14edc8c599d-maas-api-service-ca\") pod \"97c53f1d-5117-4577-813c-d14edc8c599d\" (UID: \"97c53f1d-5117-4577-813c-d14edc8c599d\") "
Jul 16 17:59:24.661673 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:24.661647    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97c53f1d-5117-4577-813c-d14edc8c599d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97c53f1d-5117-4577-813c-d14edc8c599d" (UID: "97c53f1d-5117-4577-813c-d14edc8c599d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:59:24.761805 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:24.761776    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97c53f1d-5117-4577-813c-d14edc8c599d-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 17:59:25.472062 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:25.472035    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf"
Jul 16 17:59:25.472062 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:25.472046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf" event={"ID":"97c53f1d-5117-4577-813c-d14edc8c599d","Type":"ContainerDied","Data":"2e83c85d5a4822d179783851cd19f2507a381310c88af8e3a2c74531c530c3b7"}
Jul 16 17:59:25.472265 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:25.472091    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2e83c85d5a4822d179783851cd19f2507a381310c88af8e3a2c74531c530c3b7"
Jul 16 17:59:35.246155 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:35.246117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:59:46.789290 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789253    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"]
Jul 16 17:59:46.789733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789584    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97c53f1d-5117-4577-813c-d14edc8c599d" containerName="revoke-keys"
Jul 16 17:59:46.789733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789596    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97c53f1d-5117-4577-813c-d14edc8c599d" containerName="revoke-keys"
Jul 16 17:59:46.789733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789606    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:46.789733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789612    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:46.789733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789664    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4acf4b1-43d5-4c01-b1e5-31e0fa87f1f9" containerName="revoke-keys"
Jul 16 17:59:46.789733 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.789672    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97c53f1d-5117-4577-813c-d14edc8c599d" containerName="revoke-keys"
Jul 16 17:59:46.792477 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.792460    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 17:59:46.795078 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.795051    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 17:59:46.795188 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.795082    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 17:59:46.800497 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.800470    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"]
Jul 16 17:59:46.842210 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.842178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19a694ed-f498-47b8-882c-0b442d2aa82c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz\" (UID: \"19a694ed-f498-47b8-882c-0b442d2aa82c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 17:59:46.942661 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.942625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19a694ed-f498-47b8-882c-0b442d2aa82c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz\" (UID: \"19a694ed-f498-47b8-882c-0b442d2aa82c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 17:59:46.943263 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:46.943241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19a694ed-f498-47b8-882c-0b442d2aa82c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz\" (UID: \"19a694ed-f498-47b8-882c-0b442d2aa82c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 17:59:47.103524 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:47.103439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 17:59:47.241669 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:47.241644    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"]
Jul 16 17:59:47.244476 ip-10-0-134-187 kubenswrapper[2577]: W0716 17:59:47.244450    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a694ed_f498_47b8_882c_0b442d2aa82c.slice/crio-27f010d5c7a23e87f662b69d5999c74ef49ef9bb526f39170b652c3a64749580 WatchSource:0}: Error finding container 27f010d5c7a23e87f662b69d5999c74ef49ef9bb526f39170b652c3a64749580: Status 404 returned error can't find the container with id 27f010d5c7a23e87f662b69d5999c74ef49ef9bb526f39170b652c3a64749580
Jul 16 17:59:47.443615 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:47.443537    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 17:59:47.568225 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:47.568192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" event={"ID":"19a694ed-f498-47b8-882c-0b442d2aa82c","Type":"ContainerStarted","Data":"d4cadb1e64d7c84e03354cb8c2a271304b1ee0071a1efc2a4221a501a5cd1620"}
Jul 16 17:59:47.568357 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:47.568249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" event={"ID":"19a694ed-f498-47b8-882c-0b442d2aa82c","Type":"ContainerStarted","Data":"27f010d5c7a23e87f662b69d5999c74ef49ef9bb526f39170b652c3a64749580"}
Jul 16 17:59:47.587063 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:47.587021    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" podStartSLOduration=1.587006344 podStartE2EDuration="1.587006344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:59:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:59:47.586037367 +0000 UTC m=+1867.102635503" watchObservedRunningTime="2026-07-16 17:59:47.587006344 +0000 UTC m=+1867.103604262"
Jul 16 17:59:48.574086 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:48.574050    2577 generic.go:356] "Generic (PLEG): container finished" podID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerID="d4cadb1e64d7c84e03354cb8c2a271304b1ee0071a1efc2a4221a501a5cd1620" exitCode=7
Jul 16 17:59:48.574512 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:48.574122    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" event={"ID":"19a694ed-f498-47b8-882c-0b442d2aa82c","Type":"ContainerDied","Data":"d4cadb1e64d7c84e03354cb8c2a271304b1ee0071a1efc2a4221a501a5cd1620"}
Jul 16 17:59:48.574512 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:48.574294    2577 scope.go:117] "RemoveContainer" containerID="d4cadb1e64d7c84e03354cb8c2a271304b1ee0071a1efc2a4221a501a5cd1620"
Jul 16 17:59:49.580993 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:49.580957    2577 generic.go:356] "Generic (PLEG): container finished" podID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerID="90faae986ca69932d32a599e2741feb7314b7044363243fa919f2a7ef4d51cdd" exitCode=7
Jul 16 17:59:49.581433 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:49.581043    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" event={"ID":"19a694ed-f498-47b8-882c-0b442d2aa82c","Type":"ContainerDied","Data":"90faae986ca69932d32a599e2741feb7314b7044363243fa919f2a7ef4d51cdd"}
Jul 16 17:59:49.581433 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:49.581096    2577 scope.go:117] "RemoveContainer" containerID="d4cadb1e64d7c84e03354cb8c2a271304b1ee0071a1efc2a4221a501a5cd1620"
Jul 16 17:59:49.581433 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:49.581304    2577 scope.go:117] "RemoveContainer" containerID="90faae986ca69932d32a599e2741feb7314b7044363243fa919f2a7ef4d51cdd"
Jul 16 17:59:49.581569 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:59:49.581499    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz_odh-ai-gateway-infra(19a694ed-f498-47b8-882c-0b442d2aa82c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c"
Jul 16 17:59:50.587724 ip-10-0-134-187 kubenswrapper[2577]: I0716 17:59:50.587699    2577 scope.go:117] "RemoveContainer" containerID="90faae986ca69932d32a599e2741feb7314b7044363243fa919f2a7ef4d51cdd"
Jul 16 17:59:50.588107 ip-10-0-134-187 kubenswrapper[2577]: E0716 17:59:50.587906    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz_odh-ai-gateway-infra(19a694ed-f498-47b8-882c-0b442d2aa82c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c"
Jul 16 18:00:00.147224 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.147186    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"]
Jul 16 18:00:00.152606 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.152581    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"]
Jul 16 18:00:00.152736 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.152690    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"
Jul 16 18:00:00.155610 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.155595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"
Jul 16 18:00:00.161054 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.161024    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"]
Jul 16 18:00:00.163090 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.163048    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"]
Jul 16 18:00:00.165495 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.165475    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"
Jul 16 18:00:00.173775 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.173757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"
Jul 16 18:00:00.318210 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.318179    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"]
Jul 16 18:00:00.321162 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:00:00.321134    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc1d41e_57de_4fb1_b692_857131cb2626.slice/crio-0dccffbfeeb7462c56beb2f5ebc701c30c793cf703d0eb5d3d49c7e2982896a8 WatchSource:0}: Error finding container 0dccffbfeeb7462c56beb2f5ebc701c30c793cf703d0eb5d3d49c7e2982896a8: Status 404 returned error can't find the container with id 0dccffbfeeb7462c56beb2f5ebc701c30c793cf703d0eb5d3d49c7e2982896a8
Jul 16 18:00:00.334130 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.334109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"]
Jul 16 18:00:00.336816 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:00:00.336795    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7bc127_40c0_4356_bb9f_2bf36592aeb5.slice/crio-572e4ab0a03e1c428b2f644a7df58697ad17a38be3ca26d27c06585841d32ba4 WatchSource:0}: Error finding container 572e4ab0a03e1c428b2f644a7df58697ad17a38be3ca26d27c06585841d32ba4: Status 404 returned error can't find the container with id 572e4ab0a03e1c428b2f644a7df58697ad17a38be3ca26d27c06585841d32ba4
Jul 16 18:00:00.630389 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.630355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x" event={"ID":"efc1d41e-57de-4fb1-b692-857131cb2626","Type":"ContainerStarted","Data":"0dccffbfeeb7462c56beb2f5ebc701c30c793cf703d0eb5d3d49c7e2982896a8"}
Jul 16 18:00:00.631703 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:00.631672    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k" event={"ID":"5d7bc127-40c0-4356-bb9f-2bf36592aeb5","Type":"ContainerStarted","Data":"572e4ab0a03e1c428b2f644a7df58697ad17a38be3ca26d27c06585841d32ba4"}
Jul 16 18:00:01.638506 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:01.638476    2577 generic.go:356] "Generic (PLEG): container finished" podID="5d7bc127-40c0-4356-bb9f-2bf36592aeb5" containerID="e88f172e06db1b10d7741b5e593f35ec85216b8a59c28a7af6d778dfaa322d00" exitCode=0
Jul 16 18:00:01.638941 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:01.638560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k" event={"ID":"5d7bc127-40c0-4356-bb9f-2bf36592aeb5","Type":"ContainerDied","Data":"e88f172e06db1b10d7741b5e593f35ec85216b8a59c28a7af6d778dfaa322d00"}
Jul 16 18:00:01.639979 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:01.639954    2577 generic.go:356] "Generic (PLEG): container finished" podID="efc1d41e-57de-4fb1-b692-857131cb2626" containerID="11640dae2fa94bae33d0ec4fcc8f0ae0a93bd047b35afae7b25b7a1e5a1f14a2" exitCode=0
Jul 16 18:00:01.640075 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:01.639994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x" event={"ID":"efc1d41e-57de-4fb1-b692-857131cb2626","Type":"ContainerDied","Data":"11640dae2fa94bae33d0ec4fcc8f0ae0a93bd047b35afae7b25b7a1e5a1f14a2"}
Jul 16 18:00:02.772171 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:02.772148    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"
Jul 16 18:00:02.795779 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:02.795758    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"
Jul 16 18:00:03.650484 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.650455    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x"
Jul 16 18:00:03.650668 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.650489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-qmr4x" event={"ID":"efc1d41e-57de-4fb1-b692-857131cb2626","Type":"ContainerDied","Data":"0dccffbfeeb7462c56beb2f5ebc701c30c793cf703d0eb5d3d49c7e2982896a8"}
Jul 16 18:00:03.650668 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.650537    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0dccffbfeeb7462c56beb2f5ebc701c30c793cf703d0eb5d3d49c7e2982896a8"
Jul 16 18:00:03.651663 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.651639    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"
Jul 16 18:00:03.651663 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.651658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k" event={"ID":"5d7bc127-40c0-4356-bb9f-2bf36592aeb5","Type":"ContainerDied","Data":"572e4ab0a03e1c428b2f644a7df58697ad17a38be3ca26d27c06585841d32ba4"}
Jul 16 18:00:03.651815 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.651691    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="572e4ab0a03e1c428b2f644a7df58697ad17a38be3ca26d27c06585841d32ba4"
Jul 16 18:00:03.977531 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:03.977455    2577 scope.go:117] "RemoveContainer" containerID="90faae986ca69932d32a599e2741feb7314b7044363243fa919f2a7ef4d51cdd"
Jul 16 18:00:04.657307 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:04.657280    2577 generic.go:356] "Generic (PLEG): container finished" podID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerID="0cf71dbd098293c171bd79fc6d08359853ff988c666466135658ba11ff6925e6" exitCode=0
Jul 16 18:00:04.657431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:04.657363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" event={"ID":"19a694ed-f498-47b8-882c-0b442d2aa82c","Type":"ContainerDied","Data":"0cf71dbd098293c171bd79fc6d08359853ff988c666466135658ba11ff6925e6"}
Jul 16 18:00:04.657431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:04.657424    2577 scope.go:117] "RemoveContainer" containerID="90faae986ca69932d32a599e2741feb7314b7044363243fa919f2a7ef4d51cdd"
Jul 16 18:00:05.705789 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:05.705750    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"]
Jul 16 18:00:05.788059 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:05.788030    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 18:00:05.886369 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:05.886322    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19a694ed-f498-47b8-882c-0b442d2aa82c-maas-api-service-ca\") pod \"19a694ed-f498-47b8-882c-0b442d2aa82c\" (UID: \"19a694ed-f498-47b8-882c-0b442d2aa82c\") "
Jul 16 18:00:05.886651 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:05.886630    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19a694ed-f498-47b8-882c-0b442d2aa82c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19a694ed-f498-47b8-882c-0b442d2aa82c" (UID: "19a694ed-f498-47b8-882c-0b442d2aa82c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:00:05.987734 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:05.987671    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19a694ed-f498-47b8-882c-0b442d2aa82c-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:00:06.668203 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:06.668171    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"
Jul 16 18:00:06.668396 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:06.668208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz" event={"ID":"19a694ed-f498-47b8-882c-0b442d2aa82c","Type":"ContainerDied","Data":"27f010d5c7a23e87f662b69d5999c74ef49ef9bb526f39170b652c3a64749580"}
Jul 16 18:00:06.668396 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:06.668284    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27f010d5c7a23e87f662b69d5999c74ef49ef9bb526f39170b652c3a64749580"
Jul 16 18:00:06.728692 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:06.728662    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"]
Jul 16 18:00:06.735713 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:06.735689    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-vlrsz"]
Jul 16 18:00:06.982808 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:06.982727    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" path="/var/lib/kubelet/pods/19a694ed-f498-47b8-882c-0b442d2aa82c/volumes"
Jul 16 18:00:36.873638 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873601    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"]
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873920    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873931    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873951    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7bc127-40c0-4356-bb9f-2bf36592aeb5" containerName="cleanup"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873957    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7bc127-40c0-4356-bb9f-2bf36592aeb5" containerName="cleanup"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873963    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873969    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873976    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc1d41e-57de-4fb1-b692-857131cb2626" containerName="cleanup"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.873982    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc1d41e-57de-4fb1-b692-857131cb2626" containerName="cleanup"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.874040    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.874047    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc1d41e-57de-4fb1-b692-857131cb2626" containerName="cleanup"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.874055    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:00:36.876032 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.874062    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7bc127-40c0-4356-bb9f-2bf36592aeb5" containerName="cleanup"
Jul 16 18:00:36.876941 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.876924    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:36.879537 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.879516    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:00:36.879667 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.879562    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:00:36.890470 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:36.890446    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"]
Jul 16 18:00:37.034398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.034358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/579843b1-6b66-4336-b1fa-940cc0804ce7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm\" (UID: \"579843b1-6b66-4336-b1fa-940cc0804ce7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:37.135617 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.135529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/579843b1-6b66-4336-b1fa-940cc0804ce7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm\" (UID: \"579843b1-6b66-4336-b1fa-940cc0804ce7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:37.136252 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.136230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/579843b1-6b66-4336-b1fa-940cc0804ce7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm\" (UID: \"579843b1-6b66-4336-b1fa-940cc0804ce7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:37.186633 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.186608    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:37.319149 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.319126    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"]
Jul 16 18:00:37.320905 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:00:37.320873    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod579843b1_6b66_4336_b1fa_940cc0804ce7.slice/crio-6a4609dfae5e09bce291e99a3a544520e066e1705aa563bdef6d17fe8dd06e7e WatchSource:0}: Error finding container 6a4609dfae5e09bce291e99a3a544520e066e1705aa563bdef6d17fe8dd06e7e: Status 404 returned error can't find the container with id 6a4609dfae5e09bce291e99a3a544520e066e1705aa563bdef6d17fe8dd06e7e
Jul 16 18:00:37.807745 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.807647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm" event={"ID":"579843b1-6b66-4336-b1fa-940cc0804ce7","Type":"ContainerStarted","Data":"79744492e219f66f9f4164874e9ae2c336a8b515b7377bc8ed303506979b994d"}
Jul 16 18:00:37.807745 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.807699    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm" event={"ID":"579843b1-6b66-4336-b1fa-940cc0804ce7","Type":"ContainerStarted","Data":"6a4609dfae5e09bce291e99a3a544520e066e1705aa563bdef6d17fe8dd06e7e"}
Jul 16 18:00:37.835285 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:37.835224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm" podStartSLOduration=1.835209083 podStartE2EDuration="1.835209083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:00:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:00:37.834496835 +0000 UTC m=+1917.351094776" watchObservedRunningTime="2026-07-16 18:00:37.835209083 +0000 UTC m=+1917.351807003"
Jul 16 18:00:38.813637 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:38.813602    2577 generic.go:356] "Generic (PLEG): container finished" podID="579843b1-6b66-4336-b1fa-940cc0804ce7" containerID="79744492e219f66f9f4164874e9ae2c336a8b515b7377bc8ed303506979b994d" exitCode=0
Jul 16 18:00:38.814015 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:38.813691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm" event={"ID":"579843b1-6b66-4336-b1fa-940cc0804ce7","Type":"ContainerDied","Data":"79744492e219f66f9f4164874e9ae2c336a8b515b7377bc8ed303506979b994d"}
Jul 16 18:00:39.939633 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:39.939611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:40.059660 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:40.059621    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/579843b1-6b66-4336-b1fa-940cc0804ce7-maas-api-service-ca\") pod \"579843b1-6b66-4336-b1fa-940cc0804ce7\" (UID: \"579843b1-6b66-4336-b1fa-940cc0804ce7\") "
Jul 16 18:00:40.059959 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:40.059937    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/579843b1-6b66-4336-b1fa-940cc0804ce7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "579843b1-6b66-4336-b1fa-940cc0804ce7" (UID: "579843b1-6b66-4336-b1fa-940cc0804ce7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:00:40.160827 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:40.160737    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/579843b1-6b66-4336-b1fa-940cc0804ce7-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:00:40.823629 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:40.823592    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm" event={"ID":"579843b1-6b66-4336-b1fa-940cc0804ce7","Type":"ContainerDied","Data":"6a4609dfae5e09bce291e99a3a544520e066e1705aa563bdef6d17fe8dd06e7e"}
Jul 16 18:00:40.823629 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:40.823616    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm"
Jul 16 18:00:40.823858 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:40.823652    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a4609dfae5e09bce291e99a3a544520e066e1705aa563bdef6d17fe8dd06e7e"
Jul 16 18:00:46.935080 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:46.935048    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"]
Jul 16 18:00:46.940891 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:46.940866    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-41fe79b5-29737080-k7x4k"]
Jul 16 18:00:46.982487 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:46.982461    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d7bc127-40c0-4356-bb9f-2bf36592aeb5" path="/var/lib/kubelet/pods/5d7bc127-40c0-4356-bb9f-2bf36592aeb5/volumes"
Jul 16 18:00:49.750564 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:00:49.750521    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:01:05.038477 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:05.038438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:01:06.121395 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121358    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"]
Jul 16 18:01:06.121754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121663    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579843b1-6b66-4336-b1fa-940cc0804ce7" containerName="revoke-keys"
Jul 16 18:01:06.121754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121674    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="579843b1-6b66-4336-b1fa-940cc0804ce7" containerName="revoke-keys"
Jul 16 18:01:06.121754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121690    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:01:06.121754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121695    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:01:06.121754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121747    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="579843b1-6b66-4336-b1fa-940cc0804ce7" containerName="revoke-keys"
Jul 16 18:01:06.121754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.121755    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a694ed-f498-47b8-882c-0b442d2aa82c" containerName="revoke-keys"
Jul 16 18:01:06.124683 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.124663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:06.127176 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.127141    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:01:06.127176 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.127164    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:01:06.132531 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.132507    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"]
Jul 16 18:01:06.159711 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.159683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e38388a0-64d0-444e-b74c-58f061cfbc70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5410de53-mjf85\" (UID: \"e38388a0-64d0-444e-b74c-58f061cfbc70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:06.260997 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.260967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e38388a0-64d0-444e-b74c-58f061cfbc70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5410de53-mjf85\" (UID: \"e38388a0-64d0-444e-b74c-58f061cfbc70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:06.261606 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.261590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e38388a0-64d0-444e-b74c-58f061cfbc70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5410de53-mjf85\" (UID: \"e38388a0-64d0-444e-b74c-58f061cfbc70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:06.436588 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.436555    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:06.560724 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.560697    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"]
Jul 16 18:01:06.563117 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:01:06.563088    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode38388a0_64d0_444e_b74c_58f061cfbc70.slice/crio-4c080ba55c64f6a66e6699592d64afed562565b9f77cb6e2440395972029093a WatchSource:0}: Error finding container 4c080ba55c64f6a66e6699592d64afed562565b9f77cb6e2440395972029093a: Status 404 returned error can't find the container with id 4c080ba55c64f6a66e6699592d64afed562565b9f77cb6e2440395972029093a
Jul 16 18:01:06.947702 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.947671    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" event={"ID":"e38388a0-64d0-444e-b74c-58f061cfbc70","Type":"ContainerStarted","Data":"a978521be6f05c69f8eb08af454149d490bddbcf313f8579110fbbb5506a90a8"}
Jul 16 18:01:06.947876 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.947718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" event={"ID":"e38388a0-64d0-444e-b74c-58f061cfbc70","Type":"ContainerStarted","Data":"4c080ba55c64f6a66e6699592d64afed562565b9f77cb6e2440395972029093a"}
Jul 16 18:01:06.968754 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:06.968707    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" podStartSLOduration=0.968691448 podStartE2EDuration="968.691448ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:01:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:01:06.967940128 +0000 UTC m=+1946.484538047" watchObservedRunningTime="2026-07-16 18:01:06.968691448 +0000 UTC m=+1946.485289357"
Jul 16 18:01:07.953210 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:07.953175    2577 generic.go:356] "Generic (PLEG): container finished" podID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerID="a978521be6f05c69f8eb08af454149d490bddbcf313f8579110fbbb5506a90a8" exitCode=7
Jul 16 18:01:07.953676 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:07.953241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" event={"ID":"e38388a0-64d0-444e-b74c-58f061cfbc70","Type":"ContainerDied","Data":"a978521be6f05c69f8eb08af454149d490bddbcf313f8579110fbbb5506a90a8"}
Jul 16 18:01:07.953676 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:07.953440    2577 scope.go:117] "RemoveContainer" containerID="a978521be6f05c69f8eb08af454149d490bddbcf313f8579110fbbb5506a90a8"
Jul 16 18:01:08.959505 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:08.959419    2577 generic.go:356] "Generic (PLEG): container finished" podID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerID="c7a2e810535026ffc82628f06d302e37b15aae75f1e5eff378129b6fe9edd594" exitCode=7
Jul 16 18:01:08.959505 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:08.959485    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" event={"ID":"e38388a0-64d0-444e-b74c-58f061cfbc70","Type":"ContainerDied","Data":"c7a2e810535026ffc82628f06d302e37b15aae75f1e5eff378129b6fe9edd594"}
Jul 16 18:01:08.959963 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:08.959533    2577 scope.go:117] "RemoveContainer" containerID="a978521be6f05c69f8eb08af454149d490bddbcf313f8579110fbbb5506a90a8"
Jul 16 18:01:08.959963 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:08.959700    2577 scope.go:117] "RemoveContainer" containerID="c7a2e810535026ffc82628f06d302e37b15aae75f1e5eff378129b6fe9edd594"
Jul 16 18:01:08.959963 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:01:08.959905    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5410de53-mjf85_odh-ai-gateway-infra(e38388a0-64d0-444e-b74c-58f061cfbc70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70"
Jul 16 18:01:09.966046 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:09.966016    2577 scope.go:117] "RemoveContainer" containerID="c7a2e810535026ffc82628f06d302e37b15aae75f1e5eff378129b6fe9edd594"
Jul 16 18:01:09.966448 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:01:09.966222    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-5410de53-mjf85_odh-ai-gateway-infra(e38388a0-64d0-444e-b74c-58f061cfbc70)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70"
Jul 16 18:01:23.977187 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:23.977150    2577 scope.go:117] "RemoveContainer" containerID="c7a2e810535026ffc82628f06d302e37b15aae75f1e5eff378129b6fe9edd594"
Jul 16 18:01:25.032116 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:25.032085    2577 generic.go:356] "Generic (PLEG): container finished" podID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerID="63e8ac54c238feb1e542da98eda230023ee0bc54f27c1e7b73f633e7cae0f2f7" exitCode=0
Jul 16 18:01:25.032500 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:25.032172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" event={"ID":"e38388a0-64d0-444e-b74c-58f061cfbc70","Type":"ContainerDied","Data":"63e8ac54c238feb1e542da98eda230023ee0bc54f27c1e7b73f633e7cae0f2f7"}
Jul 16 18:01:25.032500 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:25.032234    2577 scope.go:117] "RemoveContainer" containerID="c7a2e810535026ffc82628f06d302e37b15aae75f1e5eff378129b6fe9edd594"
Jul 16 18:01:26.064902 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:26.064871    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"]
Jul 16 18:01:26.163448 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:26.163426    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:26.320782 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:26.320700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e38388a0-64d0-444e-b74c-58f061cfbc70-maas-api-service-ca\") pod \"e38388a0-64d0-444e-b74c-58f061cfbc70\" (UID: \"e38388a0-64d0-444e-b74c-58f061cfbc70\") "
Jul 16 18:01:26.321092 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:26.321068    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e38388a0-64d0-444e-b74c-58f061cfbc70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e38388a0-64d0-444e-b74c-58f061cfbc70" (UID: "e38388a0-64d0-444e-b74c-58f061cfbc70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:01:26.421591 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:26.421561    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e38388a0-64d0-444e-b74c-58f061cfbc70-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:01:27.043706 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:27.043675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85" event={"ID":"e38388a0-64d0-444e-b74c-58f061cfbc70","Type":"ContainerDied","Data":"4c080ba55c64f6a66e6699592d64afed562565b9f77cb6e2440395972029093a"}
Jul 16 18:01:27.043873 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:27.043719    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c080ba55c64f6a66e6699592d64afed562565b9f77cb6e2440395972029093a"
Jul 16 18:01:27.043873 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:27.043681    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"
Jul 16 18:01:27.083227 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:27.083194    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"]
Jul 16 18:01:27.088671 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:27.088647    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-mjf85"]
Jul 16 18:01:28.982895 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:01:28.982861    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" path="/var/lib/kubelet/pods/e38388a0-64d0-444e-b74c-58f061cfbc70/volumes"
Jul 16 18:02:06.178693 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178612    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"]
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178910    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178920    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178934    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178940    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178946    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.178951    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.179009    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.179079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.179017    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:02:06.181945 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.181927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:06.184697 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.184676    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:02:06.184807 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.184714    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:02:06.191309 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.191287    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"]
Jul 16 18:02:06.244879 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.244838    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7f789cc-b8f1-45e7-802a-08ec40d2a32a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5410de53-zmdzg\" (UID: \"e7f789cc-b8f1-45e7-802a-08ec40d2a32a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:06.346473 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.346433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7f789cc-b8f1-45e7-802a-08ec40d2a32a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5410de53-zmdzg\" (UID: \"e7f789cc-b8f1-45e7-802a-08ec40d2a32a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:06.347393 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.347365    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7f789cc-b8f1-45e7-802a-08ec40d2a32a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5410de53-zmdzg\" (UID: \"e7f789cc-b8f1-45e7-802a-08ec40d2a32a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:06.493757 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.493672    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:06.620170 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:06.620136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"]
Jul 16 18:02:06.623179 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:02:06.623152    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f789cc_b8f1_45e7_802a_08ec40d2a32a.slice/crio-7c7a608f2972c3054732a1c726f69be445c6b6692d713b003aa40d1f07bc2faa WatchSource:0}: Error finding container 7c7a608f2972c3054732a1c726f69be445c6b6692d713b003aa40d1f07bc2faa: Status 404 returned error can't find the container with id 7c7a608f2972c3054732a1c726f69be445c6b6692d713b003aa40d1f07bc2faa
Jul 16 18:02:07.223261 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:07.223170    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg" event={"ID":"e7f789cc-b8f1-45e7-802a-08ec40d2a32a","Type":"ContainerStarted","Data":"9827306e1943db62ac9857b5b92a56b2b2429866d4b6ab429b8b3360eea83bc3"}
Jul 16 18:02:07.223261 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:07.223234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg" event={"ID":"e7f789cc-b8f1-45e7-802a-08ec40d2a32a","Type":"ContainerStarted","Data":"7c7a608f2972c3054732a1c726f69be445c6b6692d713b003aa40d1f07bc2faa"}
Jul 16 18:02:07.243802 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:07.243753    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg" podStartSLOduration=1.243739299 podStartE2EDuration="1.243739299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:02:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:02:07.241814429 +0000 UTC m=+2006.758412367" watchObservedRunningTime="2026-07-16 18:02:07.243739299 +0000 UTC m=+2006.760337217"
Jul 16 18:02:08.229307 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:08.229275    2577 generic.go:356] "Generic (PLEG): container finished" podID="e7f789cc-b8f1-45e7-802a-08ec40d2a32a" containerID="9827306e1943db62ac9857b5b92a56b2b2429866d4b6ab429b8b3360eea83bc3" exitCode=0
Jul 16 18:02:08.229307 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:08.229309    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg" event={"ID":"e7f789cc-b8f1-45e7-802a-08ec40d2a32a","Type":"ContainerDied","Data":"9827306e1943db62ac9857b5b92a56b2b2429866d4b6ab429b8b3360eea83bc3"}
Jul 16 18:02:09.356263 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:09.356235    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:09.469927 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:09.469898    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7f789cc-b8f1-45e7-802a-08ec40d2a32a-maas-api-service-ca\") pod \"e7f789cc-b8f1-45e7-802a-08ec40d2a32a\" (UID: \"e7f789cc-b8f1-45e7-802a-08ec40d2a32a\") "
Jul 16 18:02:09.470273 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:09.470252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7f789cc-b8f1-45e7-802a-08ec40d2a32a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e7f789cc-b8f1-45e7-802a-08ec40d2a32a" (UID: "e7f789cc-b8f1-45e7-802a-08ec40d2a32a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:02:09.570527 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:09.570500    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7f789cc-b8f1-45e7-802a-08ec40d2a32a-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:02:10.240067 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:10.240037    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg"
Jul 16 18:02:10.240067 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:10.240061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5410de53-zmdzg" event={"ID":"e7f789cc-b8f1-45e7-802a-08ec40d2a32a","Type":"ContainerDied","Data":"7c7a608f2972c3054732a1c726f69be445c6b6692d713b003aa40d1f07bc2faa"}
Jul 16 18:02:10.240277 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:10.240111    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c7a608f2972c3054732a1c726f69be445c6b6692d713b003aa40d1f07bc2faa"
Jul 16 18:02:18.950847 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:02:18.950813    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:03:41.074185 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:03:41.074158    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:03:41.076443 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:03:41.076423    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:03:41.080079 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:03:41.080061    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:03:41.082722 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:03:41.082705    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:03:57.753725 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:03:57.753695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:04:08.448353 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:08.447230    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:04:20.152580 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:20.152534    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:04:30.948158 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.948121    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"]
Jul 16 18:04:30.948548 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.948449    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f789cc-b8f1-45e7-802a-08ec40d2a32a" containerName="revoke-keys"
Jul 16 18:04:30.948548 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.948462    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f789cc-b8f1-45e7-802a-08ec40d2a32a" containerName="revoke-keys"
Jul 16 18:04:30.948548 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.948512    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38388a0-64d0-444e-b74c-58f061cfbc70" containerName="revoke-keys"
Jul 16 18:04:30.948548 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.948523    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f789cc-b8f1-45e7-802a-08ec40d2a32a" containerName="revoke-keys"
Jul 16 18:04:30.951405 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.951386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:30.954998 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.954976    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:04:30.959217 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.959199    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:04:30.982031 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:30.982012    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"]
Jul 16 18:04:31.093884 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.093853    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd83a5-343d-4b07-9b06-1c7c279a9f89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5\" (UID: \"dcbd83a5-343d-4b07-9b06-1c7c279a9f89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:31.194283 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.194254    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd83a5-343d-4b07-9b06-1c7c279a9f89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5\" (UID: \"dcbd83a5-343d-4b07-9b06-1c7c279a9f89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:31.194863 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.194843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd83a5-343d-4b07-9b06-1c7c279a9f89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5\" (UID: \"dcbd83a5-343d-4b07-9b06-1c7c279a9f89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:31.261582 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.261551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:31.387082 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.387053    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"]
Jul 16 18:04:31.389165 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:04:31.389135    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbd83a5_343d_4b07_9b06_1c7c279a9f89.slice/crio-d93bdb89ae9259ecb0cf4921ee10a10ec6bacd7fac26b8e6b55323e7d696196b WatchSource:0}: Error finding container d93bdb89ae9259ecb0cf4921ee10a10ec6bacd7fac26b8e6b55323e7d696196b: Status 404 returned error can't find the container with id d93bdb89ae9259ecb0cf4921ee10a10ec6bacd7fac26b8e6b55323e7d696196b
Jul 16 18:04:31.893662 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.893580    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5" event={"ID":"dcbd83a5-343d-4b07-9b06-1c7c279a9f89","Type":"ContainerStarted","Data":"cfcc2b305ad45e015cff42ace410ef870f073773f1955872d34eb066b27b2630"}
Jul 16 18:04:31.893662 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.893635    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5" event={"ID":"dcbd83a5-343d-4b07-9b06-1c7c279a9f89","Type":"ContainerStarted","Data":"d93bdb89ae9259ecb0cf4921ee10a10ec6bacd7fac26b8e6b55323e7d696196b"}
Jul 16 18:04:31.914814 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:31.914764    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5" podStartSLOduration=1.914746788 podStartE2EDuration="1.914746788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:04:31.913571727 +0000 UTC m=+2151.430169667" watchObservedRunningTime="2026-07-16 18:04:31.914746788 +0000 UTC m=+2151.431344745"
Jul 16 18:04:32.907322 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:32.907281    2577 generic.go:356] "Generic (PLEG): container finished" podID="dcbd83a5-343d-4b07-9b06-1c7c279a9f89" containerID="cfcc2b305ad45e015cff42ace410ef870f073773f1955872d34eb066b27b2630" exitCode=0
Jul 16 18:04:32.907709 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:32.907361    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5" event={"ID":"dcbd83a5-343d-4b07-9b06-1c7c279a9f89","Type":"ContainerDied","Data":"cfcc2b305ad45e015cff42ace410ef870f073773f1955872d34eb066b27b2630"}
Jul 16 18:04:34.034688 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.034666    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:34.116286 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.116253    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd83a5-343d-4b07-9b06-1c7c279a9f89-maas-api-service-ca\") pod \"dcbd83a5-343d-4b07-9b06-1c7c279a9f89\" (UID: \"dcbd83a5-343d-4b07-9b06-1c7c279a9f89\") "
Jul 16 18:04:34.116643 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.116610    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcbd83a5-343d-4b07-9b06-1c7c279a9f89-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dcbd83a5-343d-4b07-9b06-1c7c279a9f89" (UID: "dcbd83a5-343d-4b07-9b06-1c7c279a9f89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:04:34.217751 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.217688    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dcbd83a5-343d-4b07-9b06-1c7c279a9f89-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:04:34.917574 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.917541    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5"
Jul 16 18:04:34.917574 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.917570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5" event={"ID":"dcbd83a5-343d-4b07-9b06-1c7c279a9f89","Type":"ContainerDied","Data":"d93bdb89ae9259ecb0cf4921ee10a10ec6bacd7fac26b8e6b55323e7d696196b"}
Jul 16 18:04:34.917768 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:34.917614    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d93bdb89ae9259ecb0cf4921ee10a10ec6bacd7fac26b8e6b55323e7d696196b"
Jul 16 18:04:44.045237 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:04:44.045201    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:05:20.275407 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.275372    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"]
Jul 16 18:05:20.275983 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.275797    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbd83a5-343d-4b07-9b06-1c7c279a9f89" containerName="revoke-keys"
Jul 16 18:05:20.275983 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.275815    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbd83a5-343d-4b07-9b06-1c7c279a9f89" containerName="revoke-keys"
Jul 16 18:05:20.275983 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.275916    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbd83a5-343d-4b07-9b06-1c7c279a9f89" containerName="revoke-keys"
Jul 16 18:05:20.278893 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.278871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.281300 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.281281    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nsr52\""
Jul 16 18:05:20.281579 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.281561    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-e4fca909-serving-cert\""
Jul 16 18:05:20.282046 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.282030    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 18:05:20.282686 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.282670    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:05:20.290267 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.290246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"]
Jul 16 18:05:20.355097 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.355062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.355097 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.355096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2q55s\" (UniqueName: \"kubernetes.io/projected/1f31c333-b762-4deb-a570-9620eed8c5ea-kube-api-access-2q55s\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.355267 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.355182    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f31c333-b762-4deb-a570-9620eed8c5ea-openshift-service-ca\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.455969 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.455941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.456091 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.455975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2q55s\" (UniqueName: \"kubernetes.io/projected/1f31c333-b762-4deb-a570-9620eed8c5ea-kube-api-access-2q55s\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.456091 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.456008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f31c333-b762-4deb-a570-9620eed8c5ea-openshift-service-ca\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.456211 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:05:20.456086    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-serving-cert: secret "maas-api-e2e-mt-e4fca909-serving-cert" not found
Jul 16 18:05:20.456211 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:05:20.456156    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls podName:1f31c333-b762-4deb-a570-9620eed8c5ea nodeName:}" failed. No retries permitted until 2026-07-16 18:05:20.956139283 +0000 UTC m=+2200.472737179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls") pod "maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" (UID: "1f31c333-b762-4deb-a570-9620eed8c5ea") : secret "maas-api-e2e-mt-e4fca909-serving-cert" not found
Jul 16 18:05:20.456626 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.456609    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f31c333-b762-4deb-a570-9620eed8c5ea-openshift-service-ca\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.467462 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.467435    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2q55s\" (UniqueName: \"kubernetes.io/projected/1f31c333-b762-4deb-a570-9620eed8c5ea-kube-api-access-2q55s\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.959840 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:20.959805    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:20.960039 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:05:20.959927    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-serving-cert: secret "maas-api-e2e-mt-e4fca909-serving-cert" not found
Jul 16 18:05:20.960039 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:05:20.959980    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls podName:1f31c333-b762-4deb-a570-9620eed8c5ea nodeName:}" failed. No retries permitted until 2026-07-16 18:05:21.959964645 +0000 UTC m=+2201.476562545 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls") pod "maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" (UID: "1f31c333-b762-4deb-a570-9620eed8c5ea") : secret "maas-api-e2e-mt-e4fca909-serving-cert" not found
Jul 16 18:05:21.968501 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:21.968471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:21.970793 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:21.970776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") pod \"maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:22.089590 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:22.089561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:22.219813 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:22.219787    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"]
Jul 16 18:05:22.222432 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:05:22.222405    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f31c333_b762_4deb_a570_9620eed8c5ea.slice/crio-3593d1506e8855e93e41a67569b569323e4d0f004a23fb5437ccc2f1cd2e6b7b WatchSource:0}: Error finding container 3593d1506e8855e93e41a67569b569323e4d0f004a23fb5437ccc2f1cd2e6b7b: Status 404 returned error can't find the container with id 3593d1506e8855e93e41a67569b569323e4d0f004a23fb5437ccc2f1cd2e6b7b
Jul 16 18:05:22.224062 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:22.224044    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:05:22.957309 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:22.952729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:05:23.153303 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:23.153258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" event={"ID":"1f31c333-b762-4deb-a570-9620eed8c5ea","Type":"ContainerStarted","Data":"3593d1506e8855e93e41a67569b569323e4d0f004a23fb5437ccc2f1cd2e6b7b"}
Jul 16 18:05:25.165318 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:25.165233    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" event={"ID":"1f31c333-b762-4deb-a570-9620eed8c5ea","Type":"ContainerStarted","Data":"e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f"}
Jul 16 18:05:25.165318 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:25.165312    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:25.186300 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:25.186252    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" podStartSLOduration=2.618744815 podStartE2EDuration="5.186238739s" totalImagesPullingTime="2.567493924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:05:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:25.184715174 +0000 UTC m=+2204.701313093" watchObservedRunningTime="2026-07-16 18:05:25.186238739 +0000 UTC m=+2204.702836673"
Jul 16 18:05:31.175033 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:31.175003    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:05:41.119790 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:05:41.119757    2577 scope.go:117] "RemoveContainer" containerID="f554a10fabc2a3bbc7bc85f927f38404da9cfc3e6b5431fa1cf15bd828bdf0ba"
Jul 16 18:06:01.050383 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:01.050340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:06:27.958753 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:27.958720    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:06:34.376606 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.376575    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"]
Jul 16 18:06:34.379891 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.379874    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:34.382313 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.382291    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:06:34.387276 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.387254    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"]
Jul 16 18:06:34.505276 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.505248    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87a1717f-f13e-4bb6-8c0f-b0413f1ad33d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb\" (UID: \"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:34.606408 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.606378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87a1717f-f13e-4bb6-8c0f-b0413f1ad33d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb\" (UID: \"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:34.606943 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.606924    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87a1717f-f13e-4bb6-8c0f-b0413f1ad33d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb\" (UID: \"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:34.690928 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.690866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:34.816144 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:34.816121    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"]
Jul 16 18:06:34.818379 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:06:34.818349    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87a1717f_f13e_4bb6_8c0f_b0413f1ad33d.slice/crio-da5da7549f509b5a9ac1bcddec4c12883b374f7ff0cf27cf7b6c3659166e3fe1 WatchSource:0}: Error finding container da5da7549f509b5a9ac1bcddec4c12883b374f7ff0cf27cf7b6c3659166e3fe1: Status 404 returned error can't find the container with id da5da7549f509b5a9ac1bcddec4c12883b374f7ff0cf27cf7b6c3659166e3fe1
Jul 16 18:06:35.488433 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:35.488354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb" event={"ID":"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d","Type":"ContainerStarted","Data":"5f8b5c5a1559574442300d04dcddf6d41016bb0ce39f3620a55c6ee3ec17d0c5"}
Jul 16 18:06:35.488433 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:35.488412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb" event={"ID":"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d","Type":"ContainerStarted","Data":"da5da7549f509b5a9ac1bcddec4c12883b374f7ff0cf27cf7b6c3659166e3fe1"}
Jul 16 18:06:36.495097 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:36.495062    2577 generic.go:356] "Generic (PLEG): container finished" podID="87a1717f-f13e-4bb6-8c0f-b0413f1ad33d" containerID="5f8b5c5a1559574442300d04dcddf6d41016bb0ce39f3620a55c6ee3ec17d0c5" exitCode=0
Jul 16 18:06:36.495097 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:36.495099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb" event={"ID":"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d","Type":"ContainerDied","Data":"5f8b5c5a1559574442300d04dcddf6d41016bb0ce39f3620a55c6ee3ec17d0c5"}
Jul 16 18:06:37.621271 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:37.621245    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:37.734225 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:37.734196    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87a1717f-f13e-4bb6-8c0f-b0413f1ad33d-maas-api-service-ca\") pod \"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d\" (UID: \"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d\") "
Jul 16 18:06:37.734546 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:37.734524    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87a1717f-f13e-4bb6-8c0f-b0413f1ad33d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87a1717f-f13e-4bb6-8c0f-b0413f1ad33d" (UID: "87a1717f-f13e-4bb6-8c0f-b0413f1ad33d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:06:37.834759 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:37.834735    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87a1717f-f13e-4bb6-8c0f-b0413f1ad33d-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:06:38.505490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:38.505461    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb"
Jul 16 18:06:38.505490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:38.505484    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb" event={"ID":"87a1717f-f13e-4bb6-8c0f-b0413f1ad33d","Type":"ContainerDied","Data":"da5da7549f509b5a9ac1bcddec4c12883b374f7ff0cf27cf7b6c3659166e3fe1"}
Jul 16 18:06:38.505689 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:38.505530    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da5da7549f509b5a9ac1bcddec4c12883b374f7ff0cf27cf7b6c3659166e3fe1"
Jul 16 18:06:41.141132 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:41.141104    2577 scope.go:117] "RemoveContainer" containerID="e88f172e06db1b10d7741b5e593f35ec85216b8a59c28a7af6d778dfaa322d00"
Jul 16 18:06:41.148637 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:41.148619    2577 scope.go:117] "RemoveContainer" containerID="0cf71dbd098293c171bd79fc6d08359853ff988c666466135658ba11ff6925e6"
Jul 16 18:06:48.375399 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:48.375362    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:06:49.536256 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.536221    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"]
Jul 16 18:06:49.536689 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.536465    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" podUID="1f31c333-b762-4deb-a570-9620eed8c5ea" containerName="maas-api" containerID="cri-o://e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f" gracePeriod=30
Jul 16 18:06:49.787847 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.787795    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:06:49.822214 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.822183    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") pod \"1f31c333-b762-4deb-a570-9620eed8c5ea\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") "
Jul 16 18:06:49.822342 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.822269    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2q55s\" (UniqueName: \"kubernetes.io/projected/1f31c333-b762-4deb-a570-9620eed8c5ea-kube-api-access-2q55s\") pod \"1f31c333-b762-4deb-a570-9620eed8c5ea\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") "
Jul 16 18:06:49.822342 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.822306    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f31c333-b762-4deb-a570-9620eed8c5ea-openshift-service-ca\") pod \"1f31c333-b762-4deb-a570-9620eed8c5ea\" (UID: \"1f31c333-b762-4deb-a570-9620eed8c5ea\") "
Jul 16 18:06:49.822766 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.822737    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f31c333-b762-4deb-a570-9620eed8c5ea-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f31c333-b762-4deb-a570-9620eed8c5ea" (UID: "1f31c333-b762-4deb-a570-9620eed8c5ea"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:06:49.824287 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.824264    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f31c333-b762-4deb-a570-9620eed8c5ea-kube-api-access-2q55s" (OuterVolumeSpecName: "kube-api-access-2q55s") pod "1f31c333-b762-4deb-a570-9620eed8c5ea" (UID: "1f31c333-b762-4deb-a570-9620eed8c5ea"). InnerVolumeSpecName "kube-api-access-2q55s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:06:49.824416 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.824285    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f31c333-b762-4deb-a570-9620eed8c5ea" (UID: "1f31c333-b762-4deb-a570-9620eed8c5ea"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:06:49.923638 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.923615    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2q55s\" (UniqueName: \"kubernetes.io/projected/1f31c333-b762-4deb-a570-9620eed8c5ea-kube-api-access-2q55s\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:06:49.923638 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.923637    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f31c333-b762-4deb-a570-9620eed8c5ea-openshift-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:06:49.923774 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:49.923647    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f31c333-b762-4deb-a570-9620eed8c5ea-maas-api-tls\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:06:50.558405 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.558374    2577 generic.go:356] "Generic (PLEG): container finished" podID="1f31c333-b762-4deb-a570-9620eed8c5ea" containerID="e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f" exitCode=0
Jul 16 18:06:50.558799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.558417    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"
Jul 16 18:06:50.558799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.558463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" event={"ID":"1f31c333-b762-4deb-a570-9620eed8c5ea","Type":"ContainerDied","Data":"e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f"}
Jul 16 18:06:50.558799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.558510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw" event={"ID":"1f31c333-b762-4deb-a570-9620eed8c5ea","Type":"ContainerDied","Data":"3593d1506e8855e93e41a67569b569323e4d0f004a23fb5437ccc2f1cd2e6b7b"}
Jul 16 18:06:50.558799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.558533    2577 scope.go:117] "RemoveContainer" containerID="e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f"
Jul 16 18:06:50.567182 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.567166    2577 scope.go:117] "RemoveContainer" containerID="e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f"
Jul 16 18:06:50.567455 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:06:50.567436    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f\": container with ID starting with e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f not found: ID does not exist" containerID="e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f"
Jul 16 18:06:50.567507 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.567463    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f"} err="failed to get container status \"e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f\": rpc error: code = NotFound desc = could not find container \"e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f\": container with ID starting with e6c0c6ca17e864ee435b68fa3a205f3ec6532ae76638ed61332120db06cf1f8f not found: ID does not exist"
Jul 16 18:06:50.583287 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.583266    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"]
Jul 16 18:06:50.593132 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.593114    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-e4fca909-84fb7c55f4-x22qw"]
Jul 16 18:06:50.982384 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:50.982288    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f31c333-b762-4deb-a570-9620eed8c5ea" path="/var/lib/kubelet/pods/1f31c333-b762-4deb-a570-9620eed8c5ea/volumes"
Jul 16 18:06:57.156136 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:06:57.156103    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:07:41.167799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:07:41.167729    2577 scope.go:117] "RemoveContainer" containerID="63e8ac54c238feb1e542da98eda230023ee0bc54f27c1e7b73f633e7cae0f2f7"
Jul 16 18:07:51.958012 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:07:51.957975    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:08:02.457725 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:02.457691    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:08:41.098439 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:41.098411    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:08:41.103431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:41.103400    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:08:41.105182 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:41.105160    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:08:41.109929 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:41.109912    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:08:50.509077 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509045    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"]
Jul 16 18:08:50.509516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509367    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87a1717f-f13e-4bb6-8c0f-b0413f1ad33d" containerName="revoke-keys"
Jul 16 18:08:50.509516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509380    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="87a1717f-f13e-4bb6-8c0f-b0413f1ad33d" containerName="revoke-keys"
Jul 16 18:08:50.509516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509397    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f31c333-b762-4deb-a570-9620eed8c5ea" containerName="maas-api"
Jul 16 18:08:50.509516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509403    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f31c333-b762-4deb-a570-9620eed8c5ea" containerName="maas-api"
Jul 16 18:08:50.509516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509458    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="87a1717f-f13e-4bb6-8c0f-b0413f1ad33d" containerName="revoke-keys"
Jul 16 18:08:50.509516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.509466    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f31c333-b762-4deb-a570-9620eed8c5ea" containerName="maas-api"
Jul 16 18:08:50.512381 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.512363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.515381 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.515356    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 18:08:50.516074 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.516053    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-1fa554-serving-cert\""
Jul 16 18:08:50.516074 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.516069    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nsr52\""
Jul 16 18:08:50.516246 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.516097    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:08:50.525382 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.525357    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"]
Jul 16 18:08:50.607670 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.607648    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4224860b-620e-4ad6-aa66-b7bfbc05c456-maas-api-tls\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.607782 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.607704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4224860b-620e-4ad6-aa66-b7bfbc05c456-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.607782 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.607740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt87j\" (UniqueName: \"kubernetes.io/projected/4224860b-620e-4ad6-aa66-b7bfbc05c456-kube-api-access-qt87j\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.708295 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.708269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4224860b-620e-4ad6-aa66-b7bfbc05c456-maas-api-tls\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.708480 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.708318    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4224860b-620e-4ad6-aa66-b7bfbc05c456-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.708480 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.708364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt87j\" (UniqueName: \"kubernetes.io/projected/4224860b-620e-4ad6-aa66-b7bfbc05c456-kube-api-access-qt87j\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.708923 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.708903    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4224860b-620e-4ad6-aa66-b7bfbc05c456-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.710845 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.710828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4224860b-620e-4ad6-aa66-b7bfbc05c456-maas-api-tls\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.718852 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.718828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt87j\" (UniqueName: \"kubernetes.io/projected/4224860b-620e-4ad6-aa66-b7bfbc05c456-kube-api-access-qt87j\") pod \"maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.823305 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.823246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:50.955544 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:50.955516    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"]
Jul 16 18:08:50.957176 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:08:50.957145    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4224860b_620e_4ad6_aa66_b7bfbc05c456.slice/crio-ca31a5a46a477626262d22eedab49879485b01ce78176b3e1b87bba07d1317aa WatchSource:0}: Error finding container ca31a5a46a477626262d22eedab49879485b01ce78176b3e1b87bba07d1317aa: Status 404 returned error can't find the container with id ca31a5a46a477626262d22eedab49879485b01ce78176b3e1b87bba07d1317aa
Jul 16 18:08:51.099141 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:51.099053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq" event={"ID":"4224860b-620e-4ad6-aa66-b7bfbc05c456","Type":"ContainerStarted","Data":"ca31a5a46a477626262d22eedab49879485b01ce78176b3e1b87bba07d1317aa"}
Jul 16 18:08:52.105244 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:52.105209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq" event={"ID":"4224860b-620e-4ad6-aa66-b7bfbc05c456","Type":"ContainerStarted","Data":"6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4"}
Jul 16 18:08:52.105648 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:52.105380    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:52.127551 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:52.127510    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq" podStartSLOduration=1.677878777 podStartE2EDuration="2.127498075s" totalImagesPullingTime="449.619298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:08:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:08:52.126270258 +0000 UTC m=+2411.642868177" watchObservedRunningTime="2026-07-16 18:08:52.127498075 +0000 UTC m=+2411.644095994"
Jul 16 18:08:54.142515 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:54.142482    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:08:55.630738 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.630707    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"]
Jul 16 18:08:55.634185 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.634161    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.637500 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.637479    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-36c084-openshift-default-dockercfg-fh69d\""
Jul 16 18:08:55.655029 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.655009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"]
Jul 16 18:08:55.749390 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-data\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749390 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-credential-socket\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749625 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-token\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749625 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749484    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-socket\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749625 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-podinfo\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749625 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjw2p\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-kube-api-access-fjw2p\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749625 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749578    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-certs\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749625 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istiod-ca-cert\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.749810 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.749628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-envoy\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.850974 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.850942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-data\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.850974 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.850973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-credential-socket\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.850990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-token\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-socket\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-podinfo\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjw2p\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-kube-api-access-fjw2p\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-certs\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851454 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istiod-ca-cert\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851454 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-envoy\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851454 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-credential-socket\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851454 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-data\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851627 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-socket\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851627 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-certs\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.851937 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.851921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istiod-ca-cert\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.853538 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.853515    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-envoy\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.853538 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.853529    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-podinfo\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.864810 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.864789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-token\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.865070 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.865054    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjw2p\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-kube-api-access-fjw2p\") pod \"e2e-inf-b-36c084-openshift-default-855cc489dc-5579l\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") " pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:55.945142 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:55.945089    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:56.084996 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:56.084959    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"]
Jul 16 18:08:56.087635 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:08:56.087602    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106fefcd_0f14_4fcb_bfa6_163c10fdc94c.slice/crio-fd1cc55b281157e92d4fc9b00ad85bb295c8089619ad9962083d246a713ca233 WatchSource:0}: Error finding container fd1cc55b281157e92d4fc9b00ad85bb295c8089619ad9962083d246a713ca233: Status 404 returned error can't find the container with id fd1cc55b281157e92d4fc9b00ad85bb295c8089619ad9962083d246a713ca233
Jul 16 18:08:56.127249 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:56.127226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" event={"ID":"106fefcd-0f14-4fcb-bfa6-163c10fdc94c","Type":"ContainerStarted","Data":"fd1cc55b281157e92d4fc9b00ad85bb295c8089619ad9962083d246a713ca233"}
Jul 16 18:08:58.117595 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:58.117564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:08:58.649524 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:58.649488    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:08:58.649639 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:58.649558    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:08:58.649639 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:58.649585    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:08:59.143925 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:59.143893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" event={"ID":"106fefcd-0f14-4fcb-bfa6-163c10fdc94c","Type":"ContainerStarted","Data":"9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"}
Jul 16 18:08:59.167926 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:59.167873    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podStartSLOduration=1.6083373669999999 podStartE2EDuration="4.167859923s" totalImagesPullingTime="2.559522556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:08:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:08:59.165986467 +0000 UTC m=+2418.682584384" watchObservedRunningTime="2026-07-16 18:08:59.167859923 +0000 UTC m=+2418.684457841"
Jul 16 18:08:59.946093 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:59.946060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:08:59.950893 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:08:59.950870    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:00.149120 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:00.149095    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:00.150017 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:00.149999    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:01.288266 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.288238    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"]
Jul 16 18:09:01.291628 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.291609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.294261 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.294236    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-36c084-serving-cert\""
Jul 16 18:09:01.305436 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.305412    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"]
Jul 16 18:09:01.398774 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.398744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.398895 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.398790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58f89\" (UniqueName: \"kubernetes.io/projected/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-kube-api-access-58f89\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.398895 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.398860    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-maas-api-tls\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.499504 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.499470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.499646 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.499515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58f89\" (UniqueName: \"kubernetes.io/projected/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-kube-api-access-58f89\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.499646 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.499556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-maas-api-tls\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.500116 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.500091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-openshift-service-ca\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.501892 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.501870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-maas-api-tls\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.510166 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.510139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58f89\" (UniqueName: \"kubernetes.io/projected/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-kube-api-access-58f89\") pod \"maas-api-e2e-inf-b-36c084-694d55d986-rlkct\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.603540 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.603479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:01.746548 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:01.746512    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"]
Jul 16 18:09:01.749895 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:09:01.749856    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8855a0dd_5195_4a6e_a31c_e130c4bce6e7.slice/crio-3727ed8f291e03a0048e666a7e06cd4cc452d7a1d983f0a39de85cb87a81adef WatchSource:0}: Error finding container 3727ed8f291e03a0048e666a7e06cd4cc452d7a1d983f0a39de85cb87a81adef: Status 404 returned error can't find the container with id 3727ed8f291e03a0048e666a7e06cd4cc452d7a1d983f0a39de85cb87a81adef
Jul 16 18:09:02.159848 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:02.159808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct" event={"ID":"8855a0dd-5195-4a6e-a31c-e130c4bce6e7","Type":"ContainerStarted","Data":"a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26"}
Jul 16 18:09:02.159965 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:02.159877    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct" event={"ID":"8855a0dd-5195-4a6e-a31c-e130c4bce6e7","Type":"ContainerStarted","Data":"3727ed8f291e03a0048e666a7e06cd4cc452d7a1d983f0a39de85cb87a81adef"}
Jul 16 18:09:02.181510 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:02.181466    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct" podStartSLOduration=0.862256869 podStartE2EDuration="1.181449799s" totalImagesPullingTime="319.19293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:09:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:09:02.180212436 +0000 UTC m=+2421.696810387" watchObservedRunningTime="2026-07-16 18:09:02.181449799 +0000 UTC m=+2421.698047780"
Jul 16 18:09:03.164083 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:03.164053    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:08.207024 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:08.206990    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:09:09.174789 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:09.174758    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:09:15.618238 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:15.617037    2577 patch_prober.go:28] interesting pod/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:52152->10.132.0.38:15021: read: connection reset by peer" start-of-body=
Jul 16 18:09:15.618238 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:15.617116    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": read tcp 10.132.0.2:52152->10.132.0.38:15021: read: connection reset by peer"
Jul 16 18:09:16.224429 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:16.224398    2577 generic.go:356] "Generic (PLEG): container finished" podID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerID="9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b" exitCode=0
Jul 16 18:09:16.224634 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:16.224477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" event={"ID":"106fefcd-0f14-4fcb-bfa6-163c10fdc94c","Type":"ContainerDied","Data":"9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"}
Jul 16 18:09:16.224911 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:16.224877    2577 scope.go:117] "RemoveContainer" containerID="9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"
Jul 16 18:09:16.225901 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:16.225875    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:16.225962 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:16.225943    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:16.225996 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:16.225973    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:09:17.242751 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:17.241762    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" event={"ID":"106fefcd-0f14-4fcb-bfa6-163c10fdc94c","Type":"ContainerStarted","Data":"0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09"}
Jul 16 18:09:17.945830 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:17.945790    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:17.946131 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:17.946098    2577 patch_prober.go:28] interesting pod/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 16 18:09:17.946378 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:17.946348    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 16 18:09:18.946424 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:18.946382    2577 patch_prober.go:28] interesting pod/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 16 18:09:18.946913 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:18.946446    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 16 18:09:19.945531 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:19.945497    2577 patch_prober.go:28] interesting pod/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 16 18:09:19.945816 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:19.945787    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 16 18:09:20.945948 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:20.945908    2577 patch_prober.go:28] interesting pod/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Jul 16 18:09:20.946322 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:20.945965    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Jul 16 18:09:21.267441 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:21.267410    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:09:21.950056 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:21.950028    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:21.950438 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:21.950292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:21.950936 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:21.950919    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:09:46.657038 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:09:46.657001    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:10:05.882847 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:05.882814    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"]
Jul 16 18:10:05.886185 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:05.886169    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:05.888859 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:05.888834    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:10:05.894060 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:05.894029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"]
Jul 16 18:10:06.030509 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:06.030470    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87074bc3-32c0-4586-a493-cdbab7c7ace9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8\" (UID: \"87074bc3-32c0-4586-a493-cdbab7c7ace9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:06.130937 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:06.130892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87074bc3-32c0-4586-a493-cdbab7c7ace9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8\" (UID: \"87074bc3-32c0-4586-a493-cdbab7c7ace9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:06.131729 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:06.131708    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87074bc3-32c0-4586-a493-cdbab7c7ace9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8\" (UID: \"87074bc3-32c0-4586-a493-cdbab7c7ace9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:06.197135 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:06.197053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:06.333441 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:06.333417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"]
Jul 16 18:10:06.335361 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:10:06.335319    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87074bc3_32c0_4586_a493_cdbab7c7ace9.slice/crio-38dbe1e95e8ccef996e587eb986732603724cd442d4433dc68c9fcc9d2dadb16 WatchSource:0}: Error finding container 38dbe1e95e8ccef996e587eb986732603724cd442d4433dc68c9fcc9d2dadb16: Status 404 returned error can't find the container with id 38dbe1e95e8ccef996e587eb986732603724cd442d4433dc68c9fcc9d2dadb16
Jul 16 18:10:06.476956 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:06.476893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8" event={"ID":"87074bc3-32c0-4586-a493-cdbab7c7ace9","Type":"ContainerStarted","Data":"38dbe1e95e8ccef996e587eb986732603724cd442d4433dc68c9fcc9d2dadb16"}
Jul 16 18:10:07.483165 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:07.483079    2577 generic.go:356] "Generic (PLEG): container finished" podID="87074bc3-32c0-4586-a493-cdbab7c7ace9" containerID="e2b3750b71ec10214c5884db9d6e71dd43566c4985ed26f33bf60c1ec99e5a24" exitCode=0
Jul 16 18:10:07.483165 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:07.483116    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8" event={"ID":"87074bc3-32c0-4586-a493-cdbab7c7ace9","Type":"ContainerDied","Data":"e2b3750b71ec10214c5884db9d6e71dd43566c4985ed26f33bf60c1ec99e5a24"}
Jul 16 18:10:08.613186 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:08.613157    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:08.754908 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:08.754833    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87074bc3-32c0-4586-a493-cdbab7c7ace9-maas-api-service-ca\") pod \"87074bc3-32c0-4586-a493-cdbab7c7ace9\" (UID: \"87074bc3-32c0-4586-a493-cdbab7c7ace9\") "
Jul 16 18:10:08.755195 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:08.755173    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87074bc3-32c0-4586-a493-cdbab7c7ace9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87074bc3-32c0-4586-a493-cdbab7c7ace9" (UID: "87074bc3-32c0-4586-a493-cdbab7c7ace9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:08.855966 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:08.855941    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87074bc3-32c0-4586-a493-cdbab7c7ace9-maas-api-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:09.493179 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:09.493149    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8"
Jul 16 18:10:09.493359 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:09.493150    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8" event={"ID":"87074bc3-32c0-4586-a493-cdbab7c7ace9","Type":"ContainerDied","Data":"38dbe1e95e8ccef996e587eb986732603724cd442d4433dc68c9fcc9d2dadb16"}
Jul 16 18:10:09.493359 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:09.493267    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38dbe1e95e8ccef996e587eb986732603724cd442d4433dc68c9fcc9d2dadb16"
Jul 16 18:10:10.041799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:10.041763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:10:15.921076 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:15.921042    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"]
Jul 16 18:10:15.921483 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:15.921245    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq" podUID="4224860b-620e-4ad6-aa66-b7bfbc05c456" containerName="maas-api" containerID="cri-o://6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4" gracePeriod=30
Jul 16 18:10:16.159094 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.159068    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:10:16.313287 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.313260    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qt87j\" (UniqueName: \"kubernetes.io/projected/4224860b-620e-4ad6-aa66-b7bfbc05c456-kube-api-access-qt87j\") pod \"4224860b-620e-4ad6-aa66-b7bfbc05c456\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") "
Jul 16 18:10:16.313450 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.313310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4224860b-620e-4ad6-aa66-b7bfbc05c456-maas-api-tls\") pod \"4224860b-620e-4ad6-aa66-b7bfbc05c456\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") "
Jul 16 18:10:16.313450 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.313351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4224860b-620e-4ad6-aa66-b7bfbc05c456-openshift-service-ca\") pod \"4224860b-620e-4ad6-aa66-b7bfbc05c456\" (UID: \"4224860b-620e-4ad6-aa66-b7bfbc05c456\") "
Jul 16 18:10:16.313752 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.313723    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4224860b-620e-4ad6-aa66-b7bfbc05c456-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4224860b-620e-4ad6-aa66-b7bfbc05c456" (UID: "4224860b-620e-4ad6-aa66-b7bfbc05c456"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:16.315408 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.315377    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4224860b-620e-4ad6-aa66-b7bfbc05c456-kube-api-access-qt87j" (OuterVolumeSpecName: "kube-api-access-qt87j") pod "4224860b-620e-4ad6-aa66-b7bfbc05c456" (UID: "4224860b-620e-4ad6-aa66-b7bfbc05c456"). InnerVolumeSpecName "kube-api-access-qt87j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:10:16.315408 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.315388    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4224860b-620e-4ad6-aa66-b7bfbc05c456-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4224860b-620e-4ad6-aa66-b7bfbc05c456" (UID: "4224860b-620e-4ad6-aa66-b7bfbc05c456"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:10:16.414021 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.413997    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qt87j\" (UniqueName: \"kubernetes.io/projected/4224860b-620e-4ad6-aa66-b7bfbc05c456-kube-api-access-qt87j\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:16.414021 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.414019    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4224860b-620e-4ad6-aa66-b7bfbc05c456-maas-api-tls\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:16.414147 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.414028    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4224860b-620e-4ad6-aa66-b7bfbc05c456-openshift-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:16.529080 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.529051    2577 generic.go:356] "Generic (PLEG): container finished" podID="4224860b-620e-4ad6-aa66-b7bfbc05c456" containerID="6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4" exitCode=0
Jul 16 18:10:16.529174 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.529110    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"
Jul 16 18:10:16.529174 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.529132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq" event={"ID":"4224860b-620e-4ad6-aa66-b7bfbc05c456","Type":"ContainerDied","Data":"6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4"}
Jul 16 18:10:16.529262 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.529204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq" event={"ID":"4224860b-620e-4ad6-aa66-b7bfbc05c456","Type":"ContainerDied","Data":"ca31a5a46a477626262d22eedab49879485b01ce78176b3e1b87bba07d1317aa"}
Jul 16 18:10:16.529262 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.529234    2577 scope.go:117] "RemoveContainer" containerID="6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4"
Jul 16 18:10:16.539839 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.539820    2577 scope.go:117] "RemoveContainer" containerID="6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4"
Jul 16 18:10:16.540206 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:10:16.540189    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4\": container with ID starting with 6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4 not found: ID does not exist" containerID="6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4"
Jul 16 18:10:16.540273 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.540213    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4"} err="failed to get container status \"6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4\": rpc error: code = NotFound desc = could not find container \"6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4\": container with ID starting with 6614e2584a3c75e8a2c247dd0c69bf5cc33ad4be6c6514512ff0fe8b7b9d5da4 not found: ID does not exist"
Jul 16 18:10:16.555807 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.555788    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"]
Jul 16 18:10:16.561358 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.561338    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fa554-54f85ddf79-k2wgq"]
Jul 16 18:10:16.982850 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:16.982818    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4224860b-620e-4ad6-aa66-b7bfbc05c456" path="/var/lib/kubelet/pods/4224860b-620e-4ad6-aa66-b7bfbc05c456/volumes"
Jul 16 18:10:20.335137 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:20.335108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:10:38.639731 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.639653    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"]
Jul 16 18:10:38.640154 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.639912    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct" podUID="8855a0dd-5195-4a6e-a31c-e130c4bce6e7" containerName="maas-api" containerID="cri-o://a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26" gracePeriod=30
Jul 16 18:10:38.879040 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.879015    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:10:38.984519 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.984460    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-maas-api-tls\") pod \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") "
Jul 16 18:10:38.984519 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.984513    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58f89\" (UniqueName: \"kubernetes.io/projected/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-kube-api-access-58f89\") pod \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") "
Jul 16 18:10:38.984672 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.984578    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-openshift-service-ca\") pod \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\" (UID: \"8855a0dd-5195-4a6e-a31c-e130c4bce6e7\") "
Jul 16 18:10:38.984910 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.984884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8855a0dd-5195-4a6e-a31c-e130c4bce6e7" (UID: "8855a0dd-5195-4a6e-a31c-e130c4bce6e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:38.986503 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.986484    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8855a0dd-5195-4a6e-a31c-e130c4bce6e7" (UID: "8855a0dd-5195-4a6e-a31c-e130c4bce6e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:10:38.986610 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:38.986589    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-kube-api-access-58f89" (OuterVolumeSpecName: "kube-api-access-58f89") pod "8855a0dd-5195-4a6e-a31c-e130c4bce6e7" (UID: "8855a0dd-5195-4a6e-a31c-e130c4bce6e7"). InnerVolumeSpecName "kube-api-access-58f89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:10:39.085645 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.085592    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58f89\" (UniqueName: \"kubernetes.io/projected/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-kube-api-access-58f89\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:39.085645 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.085620    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-openshift-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:39.085645 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.085634    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8855a0dd-5195-4a6e-a31c-e130c4bce6e7-maas-api-tls\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:39.638459 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.638422    2577 generic.go:356] "Generic (PLEG): container finished" podID="8855a0dd-5195-4a6e-a31c-e130c4bce6e7" containerID="a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26" exitCode=0
Jul 16 18:10:39.638647 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.638471    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"
Jul 16 18:10:39.638647 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.638510    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct" event={"ID":"8855a0dd-5195-4a6e-a31c-e130c4bce6e7","Type":"ContainerDied","Data":"a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26"}
Jul 16 18:10:39.638647 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.638569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct" event={"ID":"8855a0dd-5195-4a6e-a31c-e130c4bce6e7","Type":"ContainerDied","Data":"3727ed8f291e03a0048e666a7e06cd4cc452d7a1d983f0a39de85cb87a81adef"}
Jul 16 18:10:39.638647 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.638597    2577 scope.go:117] "RemoveContainer" containerID="a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26"
Jul 16 18:10:39.647673 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.647493    2577 scope.go:117] "RemoveContainer" containerID="a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26"
Jul 16 18:10:39.647885 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:10:39.647764    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26\": container with ID starting with a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26 not found: ID does not exist" containerID="a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26"
Jul 16 18:10:39.647885 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.647796    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26"} err="failed to get container status \"a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26\": rpc error: code = NotFound desc = could not find container \"a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26\": container with ID starting with a5f319572428bb62c69bde339becfa774353aa59416765de56505d6bfc538f26 not found: ID does not exist"
Jul 16 18:10:39.662230 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.662206    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"]
Jul 16 18:10:39.667168 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:39.667149    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-36c084-694d55d986-rlkct"]
Jul 16 18:10:40.983793 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:40.983760    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8855a0dd-5195-4a6e-a31c-e130c4bce6e7" path="/var/lib/kubelet/pods/8855a0dd-5195-4a6e-a31c-e130c4bce6e7/volumes"
Jul 16 18:10:41.348384 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:41.348356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:10:52.095286 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:52.095255    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"]
Jul 16 18:10:52.095871 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:52.095524    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy" containerID="cri-o://0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09" gracePeriod=30
Jul 16 18:10:56.361840 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.361807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"]
Jul 16 18:10:56.362197 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362100    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8855a0dd-5195-4a6e-a31c-e130c4bce6e7" containerName="maas-api"
Jul 16 18:10:56.362197 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362111    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8855a0dd-5195-4a6e-a31c-e130c4bce6e7" containerName="maas-api"
Jul 16 18:10:56.362197 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362125    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87074bc3-32c0-4586-a493-cdbab7c7ace9" containerName="revoke-keys"
Jul 16 18:10:56.362197 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362130    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="87074bc3-32c0-4586-a493-cdbab7c7ace9" containerName="revoke-keys"
Jul 16 18:10:56.362197 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362141    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4224860b-620e-4ad6-aa66-b7bfbc05c456" containerName="maas-api"
Jul 16 18:10:56.362197 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362147    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4224860b-620e-4ad6-aa66-b7bfbc05c456" containerName="maas-api"
Jul 16 18:10:56.362406 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362203    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8855a0dd-5195-4a6e-a31c-e130c4bce6e7" containerName="maas-api"
Jul 16 18:10:56.362406 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362211    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4224860b-620e-4ad6-aa66-b7bfbc05c456" containerName="maas-api"
Jul 16 18:10:56.362406 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.362219    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="87074bc3-32c0-4586-a493-cdbab7c7ace9" containerName="revoke-keys"
Jul 16 18:10:56.365072 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.365055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.378085 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.378067    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-0baa98-serving-cert\""
Jul 16 18:10:56.378906 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.378889    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 18:10:56.379402 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.379383    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 18:10:56.393994 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.393976    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nsr52\""
Jul 16 18:10:56.396812 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.396789    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"]
Jul 16 18:10:56.410573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.410551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32479773-3b6c-43ee-96ee-ccfa068b5e3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.410674 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.410586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmnp9\" (UniqueName: \"kubernetes.io/projected/32479773-3b6c-43ee-96ee-ccfa068b5e3b-kube-api-access-dmnp9\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.410674 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.410660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32479773-3b6c-43ee-96ee-ccfa068b5e3b-maas-api-tls\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.511951 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.511901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32479773-3b6c-43ee-96ee-ccfa068b5e3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.511951 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.511947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmnp9\" (UniqueName: \"kubernetes.io/projected/32479773-3b6c-43ee-96ee-ccfa068b5e3b-kube-api-access-dmnp9\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.512212 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.512012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32479773-3b6c-43ee-96ee-ccfa068b5e3b-maas-api-tls\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.512663 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.512639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32479773-3b6c-43ee-96ee-ccfa068b5e3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.514641 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.514623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32479773-3b6c-43ee-96ee-ccfa068b5e3b-maas-api-tls\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.529787 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.529761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmnp9\" (UniqueName: \"kubernetes.io/projected/32479773-3b6c-43ee-96ee-ccfa068b5e3b-kube-api-access-dmnp9\") pod \"maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.675444 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.675383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:56.807826 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.807801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"]
Jul 16 18:10:56.809729 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:10:56.809700    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32479773_3b6c_43ee_96ee_ccfa068b5e3b.slice/crio-7ba1212f9a1c843b82abaced63a31e8fcf8738a9839ecd01484e761de0065a38 WatchSource:0}: Error finding container 7ba1212f9a1c843b82abaced63a31e8fcf8738a9839ecd01484e761de0065a38: Status 404 returned error can't find the container with id 7ba1212f9a1c843b82abaced63a31e8fcf8738a9839ecd01484e761de0065a38
Jul 16 18:10:56.811060 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:56.811042    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:10:57.335952 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.335926    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:10:57.418875 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.418792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-envoy\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.418875 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.418849    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-podinfo\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.418915    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istiod-ca-cert\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.418946    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-socket\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419123    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjw2p\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-kube-api-access-fjw2p\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419158    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-data\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419219    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-credential-socket\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419252    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-certs\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419398 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419271    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-token\") pod \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\" (UID: \"106fefcd-0f14-4fcb-bfa6-163c10fdc94c\") "
Jul 16 18:10:57.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419310    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:57.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419493    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:57.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419563    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istiod-ca-cert\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419581    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419596    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-credential-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.419836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419683    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:57.420166 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.419990    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-data" (OuterVolumeSpecName: "istio-data") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:57.421171 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.421145    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 18:10:57.421274 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.421197    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:10:57.421274 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.421244    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-kube-api-access-fjw2p" (OuterVolumeSpecName: "kube-api-access-fjw2p") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "kube-api-access-fjw2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:10:57.421390 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.421274    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-token" (OuterVolumeSpecName: "istio-token") pod "106fefcd-0f14-4fcb-bfa6-163c10fdc94c" (UID: "106fefcd-0f14-4fcb-bfa6-163c10fdc94c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:10:57.520542 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.520521    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjw2p\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-kube-api-access-fjw2p\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.520601 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.520545    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-data\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.520601 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.520556    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-workload-certs\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.520601 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.520565    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-token\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.520601 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.520572    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-envoy\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.520601 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.520579    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/106fefcd-0f14-4fcb-bfa6-163c10fdc94c-istio-podinfo\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:10:57.730899 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.730817    2577 generic.go:356] "Generic (PLEG): container finished" podID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerID="0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09" exitCode=0
Jul 16 18:10:57.730899 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.730870    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"
Jul 16 18:10:57.731088 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.730907    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" event={"ID":"106fefcd-0f14-4fcb-bfa6-163c10fdc94c","Type":"ContainerDied","Data":"0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09"}
Jul 16 18:10:57.731088 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.730967    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l" event={"ID":"106fefcd-0f14-4fcb-bfa6-163c10fdc94c","Type":"ContainerDied","Data":"fd1cc55b281157e92d4fc9b00ad85bb295c8089619ad9962083d246a713ca233"}
Jul 16 18:10:57.731088 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.730991    2577 scope.go:117] "RemoveContainer" containerID="0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09"
Jul 16 18:10:57.732515 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.732492    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h" event={"ID":"32479773-3b6c-43ee-96ee-ccfa068b5e3b","Type":"ContainerStarted","Data":"b636350ee886ff1274ac0d3733ae869b7a67ecfe305162ca6fd7751730e221c5"}
Jul 16 18:10:57.732630 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.732541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h" event={"ID":"32479773-3b6c-43ee-96ee-ccfa068b5e3b","Type":"ContainerStarted","Data":"7ba1212f9a1c843b82abaced63a31e8fcf8738a9839ecd01484e761de0065a38"}
Jul 16 18:10:57.732630 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.732599    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:10:57.739654 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.739635    2577 scope.go:117] "RemoveContainer" containerID="9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"
Jul 16 18:10:57.747447 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.747428    2577 scope.go:117] "RemoveContainer" containerID="0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09"
Jul 16 18:10:57.747707 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:10:57.747689    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09\": container with ID starting with 0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09 not found: ID does not exist" containerID="0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09"
Jul 16 18:10:57.747763 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.747713    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09"} err="failed to get container status \"0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09\": rpc error: code = NotFound desc = could not find container \"0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09\": container with ID starting with 0dfba965d47e50ba1adc6b0e6de59401c93c5acfc066efc06c841c1fb697cc09 not found: ID does not exist"
Jul 16 18:10:57.747763 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.747730    2577 scope.go:117] "RemoveContainer" containerID="9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"
Jul 16 18:10:57.747996 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:10:57.747978    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b\": container with ID starting with 9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b not found: ID does not exist" containerID="9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"
Jul 16 18:10:57.748049 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.748000    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b"} err="failed to get container status \"9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b\": rpc error: code = NotFound desc = could not find container \"9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b\": container with ID starting with 9645dd9230430e9b5ea5ba5e344896ad4637aaa47e1d28c58c3740170cf0c04b not found: ID does not exist"
Jul 16 18:10:57.759229 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.759186    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h" podStartSLOduration=1.360905106 podStartE2EDuration="1.759173369s" totalImagesPullingTime="398.268263ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:10:57.756694861 +0000 UTC m=+2537.273292798" watchObservedRunningTime="2026-07-16 18:10:57.759173369 +0000 UTC m=+2537.275771316"
Jul 16 18:10:57.774096 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.774074    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"]
Jul 16 18:10:57.784940 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:57.784922    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-36c084-openshift-default-855cc489dc-5579l"]
Jul 16 18:10:58.982110 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:10:58.982080    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" path="/var/lib/kubelet/pods/106fefcd-0f14-4fcb-bfa6-163c10fdc94c/volumes"
Jul 16 18:11:01.616935 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.616899    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"]
Jul 16 18:11:01.617399 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.617357    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy"
Jul 16 18:11:01.617399 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.617375    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy"
Jul 16 18:11:01.617399 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.617396    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy"
Jul 16 18:11:01.617570 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.617405    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy"
Jul 16 18:11:01.617570 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.617503    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy"
Jul 16 18:11:01.617570 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.617518    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="106fefcd-0f14-4fcb-bfa6-163c10fdc94c" containerName="istio-proxy"
Jul 16 18:11:01.621803 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.621782    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.624915 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.624895    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3f3f96-openshift-default-dockercfg-t9gb9\""
Jul 16 18:11:01.635884 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.635864    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"]
Jul 16 18:11:01.751289 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-credential-socket\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751289 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751293    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwvl\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-kube-api-access-xlwvl\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-certs\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istiod-ca-cert\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-socket\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-data\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-token\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-podinfo\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.751887 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.751651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-envoy\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852533 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-credential-socket\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852533 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwvl\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-kube-api-access-xlwvl\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-certs\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istiod-ca-cert\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-socket\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-data\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-token\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-podinfo\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.852747 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852738    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-envoy\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.853082 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-credential-socket\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.853082 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.852959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-certs\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.853082 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.853051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-socket\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.853362 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.853342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-data\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.853487 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.853460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istiod-ca-cert\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.855175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.855155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-envoy\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.855371 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.855352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-podinfo\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.862841 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.862819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-token\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.864191 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.864168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwvl\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-kube-api-access-xlwvl\") pod \"e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") " pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:01.931633 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:01.931577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:02.071501 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.071474    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"]
Jul 16 18:11:02.073772 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:11:02.073746    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ecbdb6_a577_4d5c_b2dc_8cd436dfae6f.slice/crio-6bb15db56f3c7387232f31e7aa96e94074da8868b0c39ecdc86be3bcde18128e WatchSource:0}: Error finding container 6bb15db56f3c7387232f31e7aa96e94074da8868b0c39ecdc86be3bcde18128e: Status 404 returned error can't find the container with id 6bb15db56f3c7387232f31e7aa96e94074da8868b0c39ecdc86be3bcde18128e
Jul 16 18:11:02.075827 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.075796    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:11:02.075910 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.075863    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:11:02.075949 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.075914    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:11:02.759812 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.759775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" event={"ID":"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f","Type":"ContainerStarted","Data":"91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"}
Jul 16 18:11:02.760224 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.759830    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" event={"ID":"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f","Type":"ContainerStarted","Data":"6bb15db56f3c7387232f31e7aa96e94074da8868b0c39ecdc86be3bcde18128e"}
Jul 16 18:11:02.793114 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.793035    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podStartSLOduration=1.793014115 podStartE2EDuration="1.793014115s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:11:02.792021006 +0000 UTC m=+2542.308618951" watchObservedRunningTime="2026-07-16 18:11:02.793014115 +0000 UTC m=+2542.309612034"
Jul 16 18:11:02.932230 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:02.932204    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:03.744261 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:03.744223    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:11:03.936474 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:03.936440    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:04.771069 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.771043    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:04.772052 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.772026    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:04.932318 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.932281    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"]
Jul 16 18:11:04.935756 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.935738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:04.939914 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.939894    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-3f3f96-serving-cert\""
Jul 16 18:11:04.970099 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.970075    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"]
Jul 16 18:11:04.976823 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.976790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsm5w\" (UniqueName: \"kubernetes.io/projected/b1710284-b4aa-4cea-a754-bbe66cbd93eb-kube-api-access-hsm5w\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:04.976946 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.976850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1710284-b4aa-4cea-a754-bbe66cbd93eb-openshift-service-ca\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:04.976946 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:04.976907    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.078161 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.078082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1710284-b4aa-4cea-a754-bbe66cbd93eb-openshift-service-ca\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.078161 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.078123    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.078161 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.078153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsm5w\" (UniqueName: \"kubernetes.io/projected/b1710284-b4aa-4cea-a754-bbe66cbd93eb-kube-api-access-hsm5w\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.078466 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:11:05.078254    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-serving-cert: secret "maas-api-e2e-api-b-3f3f96-serving-cert" not found
Jul 16 18:11:05.078466 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:11:05.078343    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls podName:b1710284-b4aa-4cea-a754-bbe66cbd93eb nodeName:}" failed. No retries permitted until 2026-07-16 18:11:05.578306941 +0000 UTC m=+2545.094904843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls") pod "maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" (UID: "b1710284-b4aa-4cea-a754-bbe66cbd93eb") : secret "maas-api-e2e-api-b-3f3f96-serving-cert" not found
Jul 16 18:11:05.078809 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.078787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1710284-b4aa-4cea-a754-bbe66cbd93eb-openshift-service-ca\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.098809 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.098782    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsm5w\" (UniqueName: \"kubernetes.io/projected/b1710284-b4aa-4cea-a754-bbe66cbd93eb-kube-api-access-hsm5w\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.126991 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.126966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:11:05.582749 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.582720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.585142 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.585116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls\") pod \"maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.846525 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.846438    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:05.984147 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:05.984120    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"]
Jul 16 18:11:05.986538 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:11:05.986509    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1710284_b4aa_4cea_a754_bbe66cbd93eb.slice/crio-aa27a8f993590f647c52858ae8ae4c4e8cecc21c287729c95204ae6f34bef49d WatchSource:0}: Error finding container aa27a8f993590f647c52858ae8ae4c4e8cecc21c287729c95204ae6f34bef49d: Status 404 returned error can't find the container with id aa27a8f993590f647c52858ae8ae4c4e8cecc21c287729c95204ae6f34bef49d
Jul 16 18:11:06.783449 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:06.783412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" event={"ID":"b1710284-b4aa-4cea-a754-bbe66cbd93eb","Type":"ContainerStarted","Data":"6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938"}
Jul 16 18:11:06.783634 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:06.783496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" event={"ID":"b1710284-b4aa-4cea-a754-bbe66cbd93eb","Type":"ContainerStarted","Data":"aa27a8f993590f647c52858ae8ae4c4e8cecc21c287729c95204ae6f34bef49d"}
Jul 16 18:11:06.808861 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:06.808814    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" podStartSLOduration=2.468232739 podStartE2EDuration="2.808800204s" totalImagesPullingTime="340.567465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:11:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:11:06.808192809 +0000 UTC m=+2546.324790746" watchObservedRunningTime="2026-07-16 18:11:06.808800204 +0000 UTC m=+2546.325398122"
Jul 16 18:11:07.788141 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:07.788115    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:13.799084 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:13.799052    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:11:20.813516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:20.813470    2577 patch_prober.go:28] interesting pod/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 16 18:11:20.813899 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:20.813534    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 16 18:11:21.550791 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:21.550755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:11:22.868219 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:22.868188    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerID="91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816" exitCode=0
Jul 16 18:11:22.868681 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:22.868263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" event={"ID":"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f","Type":"ContainerDied","Data":"91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"}
Jul 16 18:11:22.868681 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:22.868637    2577 scope.go:117] "RemoveContainer" containerID="91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"
Jul 16 18:11:22.869594 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:22.869571    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:11:22.869656 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:22.869634    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:11:22.869691 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:22.869673    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:11:23.874947 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:23.874912    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" event={"ID":"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f","Type":"ContainerStarted","Data":"f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e"}
Jul 16 18:11:23.932477 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:23.932447    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:23.932927 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:23.932668    2577 patch_prober.go:28] interesting pod/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 16 18:11:23.932927 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:23.932721    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 16 18:11:24.933187 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:24.932733    2577 patch_prober.go:28] interesting pod/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 16 18:11:24.933187 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:24.932790    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 16 18:11:25.932961 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:25.932910    2577 patch_prober.go:28] interesting pod/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 16 18:11:25.933168 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:25.932978    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 16 18:11:26.932482 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:26.932447    2577 patch_prober.go:28] interesting pod/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Jul 16 18:11:26.933070 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:26.933034    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Jul 16 18:11:27.935058 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:27.935030    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:27.935481 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:27.935304    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:27.935944 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:27.935927    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:11:32.678842 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.678810    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"]
Jul 16 18:11:32.679252 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.679007    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h" podUID="32479773-3b6c-43ee-96ee-ccfa068b5e3b" containerName="maas-api" containerID="cri-o://b636350ee886ff1274ac0d3733ae869b7a67ecfe305162ca6fd7751730e221c5" gracePeriod=30
Jul 16 18:11:32.917886 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.917857    2577 generic.go:356] "Generic (PLEG): container finished" podID="32479773-3b6c-43ee-96ee-ccfa068b5e3b" containerID="b636350ee886ff1274ac0d3733ae869b7a67ecfe305162ca6fd7751730e221c5" exitCode=0
Jul 16 18:11:32.917997 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.917941    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h" event={"ID":"32479773-3b6c-43ee-96ee-ccfa068b5e3b","Type":"ContainerDied","Data":"b636350ee886ff1274ac0d3733ae869b7a67ecfe305162ca6fd7751730e221c5"}
Jul 16 18:11:32.918043 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.918002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h" event={"ID":"32479773-3b6c-43ee-96ee-ccfa068b5e3b","Type":"ContainerDied","Data":"7ba1212f9a1c843b82abaced63a31e8fcf8738a9839ecd01484e761de0065a38"}
Jul 16 18:11:32.918043 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.918026    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ba1212f9a1c843b82abaced63a31e8fcf8738a9839ecd01484e761de0065a38"
Jul 16 18:11:32.925118 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:32.925097    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:11:33.016687 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.016663    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmnp9\" (UniqueName: \"kubernetes.io/projected/32479773-3b6c-43ee-96ee-ccfa068b5e3b-kube-api-access-dmnp9\") pod \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") "
Jul 16 18:11:33.016850 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.016743    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32479773-3b6c-43ee-96ee-ccfa068b5e3b-openshift-service-ca\") pod \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") "
Jul 16 18:11:33.016850 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.016781    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32479773-3b6c-43ee-96ee-ccfa068b5e3b-maas-api-tls\") pod \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\" (UID: \"32479773-3b6c-43ee-96ee-ccfa068b5e3b\") "
Jul 16 18:11:33.017110 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.017076    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32479773-3b6c-43ee-96ee-ccfa068b5e3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32479773-3b6c-43ee-96ee-ccfa068b5e3b" (UID: "32479773-3b6c-43ee-96ee-ccfa068b5e3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:11:33.018713 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.018690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32479773-3b6c-43ee-96ee-ccfa068b5e3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32479773-3b6c-43ee-96ee-ccfa068b5e3b" (UID: "32479773-3b6c-43ee-96ee-ccfa068b5e3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:11:33.018816 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.018794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32479773-3b6c-43ee-96ee-ccfa068b5e3b-kube-api-access-dmnp9" (OuterVolumeSpecName: "kube-api-access-dmnp9") pod "32479773-3b6c-43ee-96ee-ccfa068b5e3b" (UID: "32479773-3b6c-43ee-96ee-ccfa068b5e3b"). InnerVolumeSpecName "kube-api-access-dmnp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:11:33.117592 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.117570    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32479773-3b6c-43ee-96ee-ccfa068b5e3b-openshift-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:11:33.117592 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.117591    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32479773-3b6c-43ee-96ee-ccfa068b5e3b-maas-api-tls\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:11:33.117735 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.117600    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmnp9\" (UniqueName: \"kubernetes.io/projected/32479773-3b6c-43ee-96ee-ccfa068b5e3b-kube-api-access-dmnp9\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:11:33.922893 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.922863    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"
Jul 16 18:11:33.945924 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.945894    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"]
Jul 16 18:11:33.951167 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:33.951145    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-0baa98-754c8f56d7-vdn2h"]
Jul 16 18:11:34.982544 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:34.982511    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32479773-3b6c-43ee-96ee-ccfa068b5e3b" path="/var/lib/kubelet/pods/32479773-3b6c-43ee-96ee-ccfa068b5e3b/volumes"
Jul 16 18:11:35.944668 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:11:35.944637    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:12:00.609178 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.609147    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"]
Jul 16 18:12:00.609713 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.609364    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" podUID="b1710284-b4aa-4cea-a754-bbe66cbd93eb" containerName="maas-api" containerID="cri-o://6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938" gracePeriod=30
Jul 16 18:12:00.850240 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.850217    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:12:00.920608 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.920536    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsm5w\" (UniqueName: \"kubernetes.io/projected/b1710284-b4aa-4cea-a754-bbe66cbd93eb-kube-api-access-hsm5w\") pod \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") "
Jul 16 18:12:00.920608 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.920583    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1710284-b4aa-4cea-a754-bbe66cbd93eb-openshift-service-ca\") pod \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") "
Jul 16 18:12:00.920819 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.920611    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls\") pod \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\" (UID: \"b1710284-b4aa-4cea-a754-bbe66cbd93eb\") "
Jul 16 18:12:00.920956 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.920934    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1710284-b4aa-4cea-a754-bbe66cbd93eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1710284-b4aa-4cea-a754-bbe66cbd93eb" (UID: "b1710284-b4aa-4cea-a754-bbe66cbd93eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:12:00.922664 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.922638    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1710284-b4aa-4cea-a754-bbe66cbd93eb" (UID: "b1710284-b4aa-4cea-a754-bbe66cbd93eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:12:00.922770 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:00.922744    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1710284-b4aa-4cea-a754-bbe66cbd93eb-kube-api-access-hsm5w" (OuterVolumeSpecName: "kube-api-access-hsm5w") pod "b1710284-b4aa-4cea-a754-bbe66cbd93eb" (UID: "b1710284-b4aa-4cea-a754-bbe66cbd93eb"). InnerVolumeSpecName "kube-api-access-hsm5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:12:01.021665 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.021633    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsm5w\" (UniqueName: \"kubernetes.io/projected/b1710284-b4aa-4cea-a754-bbe66cbd93eb-kube-api-access-hsm5w\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:01.021665 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.021664    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1710284-b4aa-4cea-a754-bbe66cbd93eb-openshift-service-ca\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:01.021823 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.021677    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1710284-b4aa-4cea-a754-bbe66cbd93eb-maas-api-tls\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:01.049493 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.049462    2577 generic.go:356] "Generic (PLEG): container finished" podID="b1710284-b4aa-4cea-a754-bbe66cbd93eb" containerID="6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938" exitCode=0
Jul 16 18:12:01.049602 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.049502    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"
Jul 16 18:12:01.049602 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.049548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" event={"ID":"b1710284-b4aa-4cea-a754-bbe66cbd93eb","Type":"ContainerDied","Data":"6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938"}
Jul 16 18:12:01.049602 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.049596    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2" event={"ID":"b1710284-b4aa-4cea-a754-bbe66cbd93eb","Type":"ContainerDied","Data":"aa27a8f993590f647c52858ae8ae4c4e8cecc21c287729c95204ae6f34bef49d"}
Jul 16 18:12:01.049709 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.049617    2577 scope.go:117] "RemoveContainer" containerID="6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938"
Jul 16 18:12:01.057765 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.057750    2577 scope.go:117] "RemoveContainer" containerID="6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938"
Jul 16 18:12:01.058009 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:12:01.057991    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938\": container with ID starting with 6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938 not found: ID does not exist" containerID="6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938"
Jul 16 18:12:01.058106 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.058016    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938"} err="failed to get container status \"6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938\": rpc error: code = NotFound desc = could not find container \"6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938\": container with ID starting with 6ba97cb453fd8985d87d980c9f2b6cc6e9fd5d63c94df2dbfb37d0bb1da63938 not found: ID does not exist"
Jul 16 18:12:01.075543 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.075517    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"]
Jul 16 18:12:01.085544 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:01.085524    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-3f3f96-6d89795f46-n92t2"]
Jul 16 18:12:02.981554 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:02.981522    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1710284-b4aa-4cea-a754-bbe66cbd93eb" path="/var/lib/kubelet/pods/b1710284-b4aa-4cea-a754-bbe66cbd93eb/volumes"
Jul 16 18:12:05.172415 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:05.172383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:12:13.051595 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.051563    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"]
Jul 16 18:12:13.052057 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.051752    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy" containerID="cri-o://f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e" gracePeriod=30
Jul 16 18:12:13.983028 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.982999    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"]
Jul 16 18:12:13.983339 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.983315    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1710284-b4aa-4cea-a754-bbe66cbd93eb" containerName="maas-api"
Jul 16 18:12:13.983441 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.983344    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1710284-b4aa-4cea-a754-bbe66cbd93eb" containerName="maas-api"
Jul 16 18:12:13.983441 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.983361    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32479773-3b6c-43ee-96ee-ccfa068b5e3b" containerName="maas-api"
Jul 16 18:12:13.983441 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.983366    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="32479773-3b6c-43ee-96ee-ccfa068b5e3b" containerName="maas-api"
Jul 16 18:12:13.983441 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.983439    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="32479773-3b6c-43ee-96ee-ccfa068b5e3b" containerName="maas-api"
Jul 16 18:12:13.983653 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.983448    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1710284-b4aa-4cea-a754-bbe66cbd93eb" containerName="maas-api"
Jul 16 18:12:13.987729 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.987711    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:13.991050 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:13.991028    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7c2a35-openshift-default-dockercfg-r6dwn\""
Jul 16 18:12:14.002170 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.002130    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"]
Jul 16 18:12:14.126006 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.125972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011ca47-6d94-4097-8233-df8181bd52d4-istio-podinfo\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-data\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-certs\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-envoy\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmpnl\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-kube-api-access-xmpnl\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-credential-socket\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-istio-token\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-socket\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.126452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.126318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011ca47-6d94-4097-8233-df8181bd52d4-istiod-ca-cert\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227038 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011ca47-6d94-4097-8233-df8181bd52d4-istio-podinfo\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-data\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-certs\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227094    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-envoy\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmpnl\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-kube-api-access-xmpnl\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-credential-socket\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-istio-token\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227193 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-socket\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227587 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011ca47-6d94-4097-8233-df8181bd52d4-istiod-ca-cert\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227587 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227467    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-data\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227697 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-credential-socket\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227697 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-socket\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227793 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-certs\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.227991 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.227970    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011ca47-6d94-4097-8233-df8181bd52d4-istiod-ca-cert\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.229531 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.229504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-envoy\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.229607 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.229547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011ca47-6d94-4097-8233-df8181bd52d4-istio-podinfo\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.238036 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.237966    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmpnl\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-kube-api-access-xmpnl\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.238285 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.238267    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-istio-token\") pod \"e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") " pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.298382 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.298360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:14.433675 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.433650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"]
Jul 16 18:12:14.435546 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:12:14.435515    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc011ca47_6d94_4097_8233_df8181bd52d4.slice/crio-fb9d3b3a901240061491b9cae183379661bcde0861a840a2f9b5d4920367f2e1 WatchSource:0}: Error finding container fb9d3b3a901240061491b9cae183379661bcde0861a840a2f9b5d4920367f2e1: Status 404 returned error can't find the container with id fb9d3b3a901240061491b9cae183379661bcde0861a840a2f9b5d4920367f2e1
Jul 16 18:12:14.437687 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.437656    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:14.437785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.437719    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:14.437785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:14.437746    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:15.116923 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:15.116882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" event={"ID":"c011ca47-6d94-4097-8233-df8181bd52d4","Type":"ContainerStarted","Data":"4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"}
Jul 16 18:12:15.117102 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:15.116951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" event={"ID":"c011ca47-6d94-4097-8233-df8181bd52d4","Type":"ContainerStarted","Data":"fb9d3b3a901240061491b9cae183379661bcde0861a840a2f9b5d4920367f2e1"}
Jul 16 18:12:15.140692 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:15.140640    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podStartSLOduration=2.140623888 podStartE2EDuration="2.140623888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:12:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:12:15.138899486 +0000 UTC m=+2614.655497425" watchObservedRunningTime="2026-07-16 18:12:15.140623888 +0000 UTC m=+2614.657221870"
Jul 16 18:12:15.299116 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:15.299085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:15.303836 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:15.303806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:16.122067 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:16.122036    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:16.123043 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:16.123024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:18.303311 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.303288    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:12:18.363873 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.363803    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-token\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.363873 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.363847    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-podinfo\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.363873 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.363874    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-socket\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364124 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.363930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlwvl\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-kube-api-access-xlwvl\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364124 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.363951    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istiod-ca-cert\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364124 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.363982    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-credential-socket\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364124 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.364006    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-certs\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364124 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.364020    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-data\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364124 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.364050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-envoy\") pod \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\" (UID: \"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f\") "
Jul 16 18:12:18.364473 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.364273    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:12:18.364589 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.364544    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:12:18.364758 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.364715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:12:18.365054 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.365026    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:12:18.365191 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.365165    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:12:18.366200 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.366177    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:12:18.366304 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.366207    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 18:12:18.366304 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.366275    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:12:18.366489 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.366474    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-kube-api-access-xlwvl" (OuterVolumeSpecName: "kube-api-access-xlwvl") pod "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" (UID: "c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f"). InnerVolumeSpecName "kube-api-access-xlwvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:12:18.465342 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465301    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlwvl\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-kube-api-access-xlwvl\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465323    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istiod-ca-cert\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465361    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-credential-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465374    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-certs\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465387    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-data\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465397    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-envoy\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465404    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-token\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465413    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-istio-podinfo\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:18.465431 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:18.465421    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f-workload-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:12:19.136818 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.136781    2577 generic.go:356] "Generic (PLEG): container finished" podID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerID="f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e" exitCode=0
Jul 16 18:12:19.136988 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.136844    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"
Jul 16 18:12:19.136988 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.136859    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" event={"ID":"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f","Type":"ContainerDied","Data":"f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e"}
Jul 16 18:12:19.136988 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.136921    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg" event={"ID":"c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f","Type":"ContainerDied","Data":"6bb15db56f3c7387232f31e7aa96e94074da8868b0c39ecdc86be3bcde18128e"}
Jul 16 18:12:19.136988 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.136952    2577 scope.go:117] "RemoveContainer" containerID="f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e"
Jul 16 18:12:19.145178 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.145160    2577 scope.go:117] "RemoveContainer" containerID="91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"
Jul 16 18:12:19.152513 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.152494    2577 scope.go:117] "RemoveContainer" containerID="f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e"
Jul 16 18:12:19.152762 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:12:19.152743    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e\": container with ID starting with f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e not found: ID does not exist" containerID="f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e"
Jul 16 18:12:19.152805 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.152770    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e"} err="failed to get container status \"f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e\": rpc error: code = NotFound desc = could not find container \"f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e\": container with ID starting with f8ea6c2ed139b7e104b9bbacf0c71d2fd46dd275f611577f9c0239d9c1a0052e not found: ID does not exist"
Jul 16 18:12:19.152805 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.152786    2577 scope.go:117] "RemoveContainer" containerID="91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"
Jul 16 18:12:19.152999 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:12:19.152976    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816\": container with ID starting with 91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816 not found: ID does not exist" containerID="91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"
Jul 16 18:12:19.153036 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.153006    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816"} err="failed to get container status \"91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816\": rpc error: code = NotFound desc = could not find container \"91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816\": container with ID starting with 91addea5eb88c96071a015f08f124fc441eb5774f0acf598dd2e6a1a9fdb6816 not found: ID does not exist"
Jul 16 18:12:19.163183 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.163162    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"]
Jul 16 18:12:19.165060 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:19.165041    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3f3f96-openshift-default-58d87d5d55-h76zg"]
Jul 16 18:12:20.981802 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:20.981761    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" path="/var/lib/kubelet/pods/c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f/volumes"
Jul 16 18:12:22.435918 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.435885    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"]
Jul 16 18:12:22.436285 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.436202    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy"
Jul 16 18:12:22.436285 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.436214    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy"
Jul 16 18:12:22.436285 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.436222    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy"
Jul 16 18:12:22.436285 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.436228    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy"
Jul 16 18:12:22.436444 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.436287    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy"
Jul 16 18:12:22.436444 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.436295    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ecbdb6-a577-4d5c-b2dc-8cd436dfae6f" containerName="istio-proxy"
Jul 16 18:12:22.440616 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.440599    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.444085 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.444066    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d3e547-openshift-default-dockercfg-8q288\""
Jul 16 18:12:22.466380 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.466358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"]
Jul 16 18:12:22.595571 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istiod-ca-cert\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.595571 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-envoy\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.595799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-data\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.595799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595611    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-socket\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.595799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-credential-socket\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.595799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595718    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-token\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.595799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595765    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6dpz\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-kube-api-access-q6dpz\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.596038 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-certs\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.596038 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.595884    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-podinfo\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.696918 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.696833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-certs\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.696918 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.696871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-podinfo\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.696918 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.696914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istiod-ca-cert\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.696940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-envoy\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.696961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-data\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.696995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-socket\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-credential-socket\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-token\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6dpz\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-kube-api-access-q6dpz\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697505 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697273    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-certs\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697505 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-data\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697621 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-socket\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697673 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-credential-socket\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.697842 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.697824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istiod-ca-cert\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.699376 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.699354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-envoy\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.699567 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.699552    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-podinfo\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.708739 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.708702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-token\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.709061 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.709041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6dpz\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-kube-api-access-q6dpz\") pod \"e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") " pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.750775 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.750737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:22.899006 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.898981    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"]
Jul 16 18:12:22.900080 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:12:22.900059    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ede8f01_286e_427c_8a2f_2fc88a26c5f7.slice/crio-2feeb32abe68492db49a3cbe37f7677a372d41eab4011b361f270c2e9c077ab3 WatchSource:0}: Error finding container 2feeb32abe68492db49a3cbe37f7677a372d41eab4011b361f270c2e9c077ab3: Status 404 returned error can't find the container with id 2feeb32abe68492db49a3cbe37f7677a372d41eab4011b361f270c2e9c077ab3
Jul 16 18:12:22.902104 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.902075    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:22.902187 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.902132    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:22.902187 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.902161    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:22.993078 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:22.993036    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:12:23.160235 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:23.160204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" event={"ID":"5ede8f01-286e-427c-8a2f-2fc88a26c5f7","Type":"ContainerStarted","Data":"d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"}
Jul 16 18:12:23.160409 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:23.160254    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" event={"ID":"5ede8f01-286e-427c-8a2f-2fc88a26c5f7","Type":"ContainerStarted","Data":"2feeb32abe68492db49a3cbe37f7677a372d41eab4011b361f270c2e9c077ab3"}
Jul 16 18:12:23.209039 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:23.208934    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" podStartSLOduration=1.208917814 podStartE2EDuration="1.208917814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:12:23.207270136 +0000 UTC m=+2622.723868053" watchObservedRunningTime="2026-07-16 18:12:23.208917814 +0000 UTC m=+2622.725515732"
Jul 16 18:12:23.750968 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:23.750932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:23.755465 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:23.755439    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:24.166073 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:24.166040    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:24.167008 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:24.166987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:31.123814 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.123733    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 16 18:12:31.123814 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.123796    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 16 18:12:31.208828 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.208750    2577 generic.go:356] "Generic (PLEG): container finished" podID="c011ca47-6d94-4097-8233-df8181bd52d4" containerID="4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3" exitCode=0
Jul 16 18:12:31.208828 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.208808    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" event={"ID":"c011ca47-6d94-4097-8233-df8181bd52d4","Type":"ContainerDied","Data":"4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"}
Jul 16 18:12:31.209149 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.209136    2577 scope.go:117] "RemoveContainer" containerID="4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"
Jul 16 18:12:31.210108 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.210077    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:31.210172 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.210145    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:31.210209 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:31.210181    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:32.215259 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:32.215224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" event={"ID":"c011ca47-6d94-4097-8233-df8181bd52d4","Type":"ContainerStarted","Data":"5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80"}
Jul 16 18:12:32.298891 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:32.298858    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:32.299049 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:32.299014    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 16 18:12:32.299093 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:32.299062    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 16 18:12:33.298910 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:33.298872    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 16 18:12:33.299298 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:33.298926    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 16 18:12:34.299458 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:34.299415    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 16 18:12:34.299872 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:34.299483    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 16 18:12:35.299345 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:35.299296    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 16 18:12:35.299510 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:35.299400    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 16 18:12:35.347359 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:35.347099    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:12:36.299093 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:36.299055    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 16 18:12:36.299272 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:36.299116    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 16 18:12:37.246514 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.246420    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerID="d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426" exitCode=0
Jul 16 18:12:37.246514 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.246493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" event={"ID":"5ede8f01-286e-427c-8a2f-2fc88a26c5f7","Type":"ContainerDied","Data":"d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"}
Jul 16 18:12:37.246922 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.246830    2577 scope.go:117] "RemoveContainer" containerID="d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"
Jul 16 18:12:37.247800 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.247774    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:37.247874 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.247846    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:37.247911 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.247887    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 16 18:12:37.304149 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.304128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:37.304515 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.304485    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:37.305207 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:37.305187    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:12:38.256024 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:38.255985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" event={"ID":"5ede8f01-286e-427c-8a2f-2fc88a26c5f7","Type":"ContainerStarted","Data":"ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054"}
Jul 16 18:12:38.752412 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:38.751213    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:38.753018 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:38.752708    2577 patch_prober.go:28] interesting pod/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 16 18:12:38.753018 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:38.752763    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 16 18:12:39.166678 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:39.166647    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:39.751746 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:39.751707    2577 patch_prober.go:28] interesting pod/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 16 18:12:39.752399 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:39.752355    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 16 18:12:40.751272 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:40.751229    2577 patch_prober.go:28] interesting pod/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 16 18:12:40.751499 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:40.751294    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 16 18:12:41.752405 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:41.752358    2577 patch_prober.go:28] interesting pod/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 16 18:12:41.752801 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:41.752436    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 16 18:12:42.755588 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:42.755559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:42.756512 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:42.756489    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:12:58.075211 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:12:58.075177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:13:25.964999 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:25.964968    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:13:36.261024 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:36.260943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:13:41.126481 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:41.126449    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:13:41.133091 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:41.133067    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:13:41.133483 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:41.133452    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:13:41.139990 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:41.139974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:13:54.355053 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:13:54.355016    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:14:11.858155 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:14:11.858119    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:14:25.554254 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:14:25.554217    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:14:43.361357 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:14:43.361306    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:15:00.159737 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.159699    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"]
Jul 16 18:15:00.162983 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.162957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"
Jul 16 18:15:00.165528 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.165509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kqd5x\""
Jul 16 18:15:00.167073 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.167055    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"]
Jul 16 18:15:00.170273 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.170255    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"
Jul 16 18:15:00.173445 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.173426    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"
Jul 16 18:15:00.176298 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.176272    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"]
Jul 16 18:15:00.185231 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.185186    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"
Jul 16 18:15:00.188892 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.188869    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"]
Jul 16 18:15:00.332381 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.332355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"]
Jul 16 18:15:00.334044 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:15:00.333995    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e2d9e3_91d7_4d98_bc4c_c7b40c1f8500.slice/crio-67e4cc239f8fc17dee0f3281a1d86fb413ef0bb5b755de3af9ffdc2a9726126d WatchSource:0}: Error finding container 67e4cc239f8fc17dee0f3281a1d86fb413ef0bb5b755de3af9ffdc2a9726126d: Status 404 returned error can't find the container with id 67e4cc239f8fc17dee0f3281a1d86fb413ef0bb5b755de3af9ffdc2a9726126d
Jul 16 18:15:00.359123 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.359100    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"]
Jul 16 18:15:00.367387 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:15:00.367358    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4ca8a35_e543_4d17_84f9_a09517918a56.slice/crio-f458675f38450d3d34f29a491faec8f99826294babff3f148486956b804bdcd1 WatchSource:0}: Error finding container f458675f38450d3d34f29a491faec8f99826294babff3f148486956b804bdcd1: Status 404 returned error can't find the container with id f458675f38450d3d34f29a491faec8f99826294babff3f148486956b804bdcd1
Jul 16 18:15:00.931190 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.931153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl" event={"ID":"b4ca8a35-e543-4d17-84f9-a09517918a56","Type":"ContainerStarted","Data":"27a20f2a0138c70c4b50f3f2f3177f4d3ffe95d5d63d6c70f07e6f44a88ef22c"}
Jul 16 18:15:00.931408 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.931208    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl" event={"ID":"b4ca8a35-e543-4d17-84f9-a09517918a56","Type":"ContainerStarted","Data":"f458675f38450d3d34f29a491faec8f99826294babff3f148486956b804bdcd1"}
Jul 16 18:15:00.932573 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.932547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f" event={"ID":"54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500","Type":"ContainerStarted","Data":"78e35b85887d055c200cce36df0457ce97ea37fc38d5ba4f1fcf16c89776a59f"}
Jul 16 18:15:00.932678 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.932590    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f" event={"ID":"54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500","Type":"ContainerStarted","Data":"67e4cc239f8fc17dee0f3281a1d86fb413ef0bb5b755de3af9ffdc2a9726126d"}
Jul 16 18:15:00.955128 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.953729    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl" podStartSLOduration=0.953711122 podStartE2EDuration="953.711122ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:15:00.950280894 +0000 UTC m=+2780.466878811" watchObservedRunningTime="2026-07-16 18:15:00.953711122 +0000 UTC m=+2780.470309041"
Jul 16 18:15:00.974031 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:00.973978    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f" podStartSLOduration=0.973963183 podStartE2EDuration="973.963183ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:15:00.972319087 +0000 UTC m=+2780.488917024" watchObservedRunningTime="2026-07-16 18:15:00.973963183 +0000 UTC m=+2780.490561100"
Jul 16 18:15:01.251946 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:01.251869    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:15:01.938655 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:01.938615    2577 generic.go:356] "Generic (PLEG): container finished" podID="b4ca8a35-e543-4d17-84f9-a09517918a56" containerID="27a20f2a0138c70c4b50f3f2f3177f4d3ffe95d5d63d6c70f07e6f44a88ef22c" exitCode=0
Jul 16 18:15:01.938844 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:01.938667    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl" event={"ID":"b4ca8a35-e543-4d17-84f9-a09517918a56","Type":"ContainerDied","Data":"27a20f2a0138c70c4b50f3f2f3177f4d3ffe95d5d63d6c70f07e6f44a88ef22c"}
Jul 16 18:15:01.940098 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:01.940073    2577 generic.go:356] "Generic (PLEG): container finished" podID="54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500" containerID="78e35b85887d055c200cce36df0457ce97ea37fc38d5ba4f1fcf16c89776a59f" exitCode=0
Jul 16 18:15:01.940220 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:01.940114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f" event={"ID":"54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500","Type":"ContainerDied","Data":"78e35b85887d055c200cce36df0457ce97ea37fc38d5ba4f1fcf16c89776a59f"}
Jul 16 18:15:03.086865 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.086842    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"
Jul 16 18:15:03.089476 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.089458    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"
Jul 16 18:15:03.952060 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.952033    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"
Jul 16 18:15:03.952245 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.952033    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl" event={"ID":"b4ca8a35-e543-4d17-84f9-a09517918a56","Type":"ContainerDied","Data":"f458675f38450d3d34f29a491faec8f99826294babff3f148486956b804bdcd1"}
Jul 16 18:15:03.952245 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.952147    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f458675f38450d3d34f29a491faec8f99826294babff3f148486956b804bdcd1"
Jul 16 18:15:03.953365 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.953346    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f"
Jul 16 18:15:03.953500 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.953382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-bws8f" event={"ID":"54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500","Type":"ContainerDied","Data":"67e4cc239f8fc17dee0f3281a1d86fb413ef0bb5b755de3af9ffdc2a9726126d"}
Jul 16 18:15:03.953500 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:03.953418    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="67e4cc239f8fc17dee0f3281a1d86fb413ef0bb5b755de3af9ffdc2a9726126d"
Jul 16 18:15:22.542744 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:22.542709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:15:40.849516 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:40.849485    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:15:51.262737 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:15:51.262706    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:16:07.846719 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:16:07.846684    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:16:27.954382 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:16:27.954344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:16:46.761173 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:16:46.761137    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:17:06.840021 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:17:06.839991    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:17:19.240741 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:17:19.240703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:17:32.547975 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:17:32.547938    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:17:41.280350 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:17:41.280296    2577 scope.go:117] "RemoveContainer" containerID="b636350ee886ff1274ac0d3733ae869b7a67ecfe305162ca6fd7751730e221c5"
Jul 16 18:17:47.934742 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:17:47.934710    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:18:02.546655 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:02.546613    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:18:17.542875 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:17.542794    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:18:41.156416 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:41.156382    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:18:41.162746 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:41.162719    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:18:41.162910 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:41.162790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:18:41.169279 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:41.169257    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fshx8_4fd85dc7-f3c0-426d-acf4-774f4362a4c5/ovn-acl-logging/0.log"
Jul 16 18:18:45.740231 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:45.740194    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:18:55.214250 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:55.214211    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"]
Jul 16 18:18:55.214758 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:18:55.214451    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy" containerID="cri-o://5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80" gracePeriod=30
Jul 16 18:19:00.466560 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.466535    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:19:00.539354 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539304    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-data\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539553 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539362    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-socket\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539553 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539402    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-istio-token\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539553 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011ca47-6d94-4097-8233-df8181bd52d4-istio-podinfo\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539553 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539473    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011ca47-6d94-4097-8233-df8181bd52d4-istiod-ca-cert\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmpnl\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-kube-api-access-xmpnl\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-certs\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539717    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-envoy\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.539785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539735    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:00.539785 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539752    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-credential-socket\") pod \"c011ca47-6d94-4097-8233-df8181bd52d4\" (UID: \"c011ca47-6d94-4097-8233-df8181bd52d4\") "
Jul 16 18:19:00.540052 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539825    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c011ca47-6d94-4097-8233-df8181bd52d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:19:00.540052 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.539934    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:00.540052 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.540028    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:00.540204 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.540124    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-certs\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.540204 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.540142    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-credential-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.540204 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.540149    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:00.540204 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.540161    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-workload-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.540204 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.540183    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c011ca47-6d94-4097-8233-df8181bd52d4-istiod-ca-cert\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.541778 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.541742    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:19:00.541893 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.541800    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c011ca47-6d94-4097-8233-df8181bd52d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 18:19:00.541893 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.541830    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:00.541893 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.541848    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-kube-api-access-xmpnl" (OuterVolumeSpecName: "kube-api-access-xmpnl") pod "c011ca47-6d94-4097-8233-df8181bd52d4" (UID: "c011ca47-6d94-4097-8233-df8181bd52d4"). InnerVolumeSpecName "kube-api-access-xmpnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:19:00.641480 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.641439    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmpnl\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-kube-api-access-xmpnl\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.641480 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.641473    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-envoy\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.641480 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.641482    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c011ca47-6d94-4097-8233-df8181bd52d4-istio-data\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.641480 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.641491    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c011ca47-6d94-4097-8233-df8181bd52d4-istio-token\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:00.641750 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:00.641498    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c011ca47-6d94-4097-8233-df8181bd52d4-istio-podinfo\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:01.091641 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.091607    2577 generic.go:356] "Generic (PLEG): container finished" podID="c011ca47-6d94-4097-8233-df8181bd52d4" containerID="5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80" exitCode=0
Jul 16 18:19:01.091820 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.091653    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"
Jul 16 18:19:01.091820 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.091654    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" event={"ID":"c011ca47-6d94-4097-8233-df8181bd52d4","Type":"ContainerDied","Data":"5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80"}
Jul 16 18:19:01.091820 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.091778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7" event={"ID":"c011ca47-6d94-4097-8233-df8181bd52d4","Type":"ContainerDied","Data":"fb9d3b3a901240061491b9cae183379661bcde0861a840a2f9b5d4920367f2e1"}
Jul 16 18:19:01.091820 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.091805    2577 scope.go:117] "RemoveContainer" containerID="5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80"
Jul 16 18:19:01.100447 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.100399    2577 scope.go:117] "RemoveContainer" containerID="4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"
Jul 16 18:19:01.107847 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.107820    2577 scope.go:117] "RemoveContainer" containerID="5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80"
Jul 16 18:19:01.108091 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:19:01.108071    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80\": container with ID starting with 5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80 not found: ID does not exist" containerID="5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80"
Jul 16 18:19:01.108144 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.108099    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80"} err="failed to get container status \"5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80\": rpc error: code = NotFound desc = could not find container \"5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80\": container with ID starting with 5c1b56c61fb6b11f0b6cccaba1bd3ec9e9cec6cab00dd9fda0762c132f4aae80 not found: ID does not exist"
Jul 16 18:19:01.108144 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.108115    2577 scope.go:117] "RemoveContainer" containerID="4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"
Jul 16 18:19:01.108362 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:19:01.108348    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3\": container with ID starting with 4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3 not found: ID does not exist" containerID="4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"
Jul 16 18:19:01.108413 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.108367    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3"} err="failed to get container status \"4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3\": rpc error: code = NotFound desc = could not find container \"4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3\": container with ID starting with 4da509b619d3a92d2e1fbbf182bbfab03cc5dac568e8a4bc0960e63fbfd3f8b3 not found: ID does not exist"
Jul 16 18:19:01.114466 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.114436    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"]
Jul 16 18:19:01.120569 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:01.120547    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7c2a35-openshift-default-cf84f647-xs2q7"]
Jul 16 18:19:02.982520 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:02.982488    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" path="/var/lib/kubelet/pods/c011ca47-6d94-4097-8233-df8181bd52d4/volumes"
Jul 16 18:19:05.679348 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:05.679289    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"]
Jul 16 18:19:05.683294 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:05.683265    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-d3e547-29737095-57brl"]
Jul 16 18:19:06.982683 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:06.982647    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4ca8a35-e543-4d17-84f9-a09517918a56" path="/var/lib/kubelet/pods/b4ca8a35-e543-4d17-84f9-a09517918a56/volumes"
Jul 16 18:19:08.648392 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:08.648360    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-562t9"]
Jul 16 18:19:18.579852 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:18.579810    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"]
Jul 16 18:19:18.580389 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:18.580066    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy" containerID="cri-o://ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054" gracePeriod=30
Jul 16 18:19:23.827267 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.827243    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:19:23.929071 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.928988    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-envoy\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929071 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929020    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-data\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929071 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istiod-ca-cert\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929368 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929101    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-podinfo\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929368 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-credential-socket\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929368 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929199    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6dpz\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-kube-api-access-q6dpz\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929368 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929240    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-socket\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929368 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929294    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-certs\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929368 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929319    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-token\") pod \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\" (UID: \"5ede8f01-286e-427c-8a2f-2fc88a26c5f7\") "
Jul 16 18:19:23.929683 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:23.929683 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929542    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:23.929683 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929563    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:19:23.929851 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929708    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:23.929851 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929733    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:23.929851 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929757    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istiod-ca-cert\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:23.929851 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929774    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-credential-socket\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:23.930057 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.929991    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:23.931316 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.931287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 18:19:23.931484 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.931385    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 16 18:19:23.931798 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.931781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:19:23.931879 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:23.931796    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-kube-api-access-q6dpz" (OuterVolumeSpecName: "kube-api-access-q6dpz") pod "5ede8f01-286e-427c-8a2f-2fc88a26c5f7" (UID: "5ede8f01-286e-427c-8a2f-2fc88a26c5f7"). InnerVolumeSpecName "kube-api-access-q6dpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:19:24.031233 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.031204    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6dpz\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-kube-api-access-q6dpz\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:24.031434 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.031297    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-workload-certs\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:24.031434 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.031320    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-token\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:24.031434 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.031363    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-envoy\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:24.031434 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.031376    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-data\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:24.031434 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.031389    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ede8f01-286e-427c-8a2f-2fc88a26c5f7-istio-podinfo\") on node \"ip-10-0-134-187.ec2.internal\" DevicePath \"\""
Jul 16 18:19:24.202020 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.201931    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerID="ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054" exitCode=0
Jul 16 18:19:24.202020 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.201977    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"
Jul 16 18:19:24.202228 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.202016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" event={"ID":"5ede8f01-286e-427c-8a2f-2fc88a26c5f7","Type":"ContainerDied","Data":"ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054"}
Jul 16 18:19:24.202228 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.202072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw" event={"ID":"5ede8f01-286e-427c-8a2f-2fc88a26c5f7","Type":"ContainerDied","Data":"2feeb32abe68492db49a3cbe37f7677a372d41eab4011b361f270c2e9c077ab3"}
Jul 16 18:19:24.202228 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.202100    2577 scope.go:117] "RemoveContainer" containerID="ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054"
Jul 16 18:19:24.210902 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.210886    2577 scope.go:117] "RemoveContainer" containerID="d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"
Jul 16 18:19:24.218301 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.218277    2577 scope.go:117] "RemoveContainer" containerID="ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054"
Jul 16 18:19:24.218599 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:19:24.218579    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054\": container with ID starting with ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054 not found: ID does not exist" containerID="ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054"
Jul 16 18:19:24.218660 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.218608    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054"} err="failed to get container status \"ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054\": rpc error: code = NotFound desc = could not find container \"ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054\": container with ID starting with ec48428a915db6e2b93832f65dff426e4412e078e4e5b4b5463f8a069c632054 not found: ID does not exist"
Jul 16 18:19:24.218660 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.218625    2577 scope.go:117] "RemoveContainer" containerID="d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"
Jul 16 18:19:24.218856 ip-10-0-134-187 kubenswrapper[2577]: E0716 18:19:24.218838    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426\": container with ID starting with d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426 not found: ID does not exist" containerID="d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"
Jul 16 18:19:24.218912 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.218866    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426"} err="failed to get container status \"d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426\": rpc error: code = NotFound desc = could not find container \"d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426\": container with ID starting with d30acbb66f32014bbd5acf458ee6fc4ceaaccf2f6ed250a4863fd30aaaba4426 not found: ID does not exist"
Jul 16 18:19:24.224588 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.224566    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"]
Jul 16 18:19:24.229719 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.229697    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d3e547-openshift-default-7bdb86d6dc-lkmmw"]
Jul 16 18:19:24.982965 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:24.982930    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" path="/var/lib/kubelet/pods/5ede8f01-286e-427c-8a2f-2fc88a26c5f7/volumes"
Jul 16 18:19:25.959033 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:25.959008    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-q6d7n_af1f70fa-05b5-4c80-85a6-ff22aba7eeb3/copy-manifests/0.log"
Jul 16 18:19:25.972983 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:25.972957    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-q6d7n_af1f70fa-05b5-4c80-85a6-ff22aba7eeb3/manager/0.log"
Jul 16 18:19:26.602588 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:26.602559    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737080-qmr4x_efc1d41e-57de-4fb1-b692-857131cb2626/cleanup/0.log"
Jul 16 18:19:26.713064 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:26.713037    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737095-bws8f_54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500/cleanup/0.log"
Jul 16 18:19:26.827464 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:26.827442    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-41fe79b5-nmknm_579843b1-6b66-4336-b1fa-940cc0804ce7/revoke-keys/0.log"
Jul 16 18:19:26.938505 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:26.938429    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-8b0f3b27-2fqdn_2da4713d-6c17-4f1f-b3bf-e904e994a4e0/revoke-keys/1.log"
Jul 16 18:19:27.303030 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:27.302991    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-5410de53-zmdzg_e7f789cc-b8f1-45e7-802a-08ec40d2a32a/revoke-keys/0.log"
Jul 16 18:19:27.421181 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:27.421156    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-1fa554-59ld8_87074bc3-32c0-4586-a493-cdbab7c7ace9/revoke-keys/0.log"
Jul 16 18:19:27.656526 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:27.656460    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-8c8af3ec-q5kxf_97c53f1d-5117-4577-813c-d14edc8c599d/revoke-keys/0.log"
Jul 16 18:19:27.772299 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:27.772273    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-2ef0185a-nrdj5_dcbd83a5-343d-4b07-9b06-1c7c279a9f89/revoke-keys/0.log"
Jul 16 18:19:27.887452 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:27.887430    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-e4fca909-7vrjb_87a1717f-f13e-4bb6-8c0f-b0413f1ad33d/revoke-keys/0.log"
Jul 16 18:19:30.388819 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:30.388789    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-562t9_01d5540f-77a8-448d-93f6-184574c49015/limitador/0.log"
Jul 16 18:19:31.019717 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:31.019687    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qwfrj_dae69b9d-3503-4e8a-96b9-bc9f4cefaaea/discovery/0.log"
Jul 16 18:19:32.234774 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:32.234744    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mwmnp_6ba0c706-09fc-452c-b761-2345d34216d5/main/0.log"
Jul 16 18:19:37.869116 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869035    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w8h8n/must-gather-pdgmb"]
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869412    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4ca8a35-e543-4d17-84f9-a09517918a56" containerName="cleanup"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869427    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4ca8a35-e543-4d17-84f9-a09517918a56" containerName="cleanup"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869437    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869445    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869453    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869460    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869473    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869478    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869485    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500" containerName="cleanup"
Jul 16 18:19:37.869490 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869490    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500" containerName="cleanup"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869547    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4ca8a35-e543-4d17-84f9-a09517918a56" containerName="cleanup"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869554    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869561    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ede8f01-286e-427c-8a2f-2fc88a26c5f7" containerName="istio-proxy"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869568    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869573    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869579    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="54e2d9e3-91d7-4d98-bc4c-c7b40c1f8500" containerName="cleanup"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869641    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy"
Jul 16 18:19:37.869799 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.869646    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c011ca47-6d94-4097-8233-df8181bd52d4" containerName="istio-proxy"
Jul 16 18:19:37.873756 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.873735    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:37.876188 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.876172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w8h8n\"/\"default-dockercfg-474ns\""
Jul 16 18:19:37.876477 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.876461    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w8h8n\"/\"openshift-service-ca.crt\""
Jul 16 18:19:37.877021 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.877008    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w8h8n\"/\"kube-root-ca.crt\""
Jul 16 18:19:37.892063 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:37.892045    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w8h8n/must-gather-pdgmb"]
Jul 16 18:19:38.035153 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.035121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmhxt\" (UniqueName: \"kubernetes.io/projected/befb1cee-4af0-4d60-90ce-1bc931864267-kube-api-access-jmhxt\") pod \"must-gather-pdgmb\" (UID: \"befb1cee-4af0-4d60-90ce-1bc931864267\") " pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.035312 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.035171    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/befb1cee-4af0-4d60-90ce-1bc931864267-must-gather-output\") pod \"must-gather-pdgmb\" (UID: \"befb1cee-4af0-4d60-90ce-1bc931864267\") " pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.136030 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.135948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmhxt\" (UniqueName: \"kubernetes.io/projected/befb1cee-4af0-4d60-90ce-1bc931864267-kube-api-access-jmhxt\") pod \"must-gather-pdgmb\" (UID: \"befb1cee-4af0-4d60-90ce-1bc931864267\") " pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.136030 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.135999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/befb1cee-4af0-4d60-90ce-1bc931864267-must-gather-output\") pod \"must-gather-pdgmb\" (UID: \"befb1cee-4af0-4d60-90ce-1bc931864267\") " pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.136267 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.136250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/befb1cee-4af0-4d60-90ce-1bc931864267-must-gather-output\") pod \"must-gather-pdgmb\" (UID: \"befb1cee-4af0-4d60-90ce-1bc931864267\") " pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.144673 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.144651    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmhxt\" (UniqueName: \"kubernetes.io/projected/befb1cee-4af0-4d60-90ce-1bc931864267-kube-api-access-jmhxt\") pod \"must-gather-pdgmb\" (UID: \"befb1cee-4af0-4d60-90ce-1bc931864267\") " pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.182381 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.182357    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w8h8n/must-gather-pdgmb"
Jul 16 18:19:38.326875 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.326748    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w8h8n/must-gather-pdgmb"]
Jul 16 18:19:38.330453 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:19:38.330424    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbefb1cee_4af0_4d60_90ce_1bc931864267.slice/crio-3cb5595a25ee9e7f84ab52fcf346ea81c795b937796e0383bc664d130eb5cdf1 WatchSource:0}: Error finding container 3cb5595a25ee9e7f84ab52fcf346ea81c795b937796e0383bc664d130eb5cdf1: Status 404 returned error can't find the container with id 3cb5595a25ee9e7f84ab52fcf346ea81c795b937796e0383bc664d130eb5cdf1
Jul 16 18:19:38.332141 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:38.332122    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:19:39.273819 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:39.273790    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/must-gather-pdgmb" event={"ID":"befb1cee-4af0-4d60-90ce-1bc931864267","Type":"ContainerStarted","Data":"20ca5c00f85b0cca5508d840437b63616619c5a9ac92cfaa3da43f43886aed35"}
Jul 16 18:19:39.274143 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:39.273834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/must-gather-pdgmb" event={"ID":"befb1cee-4af0-4d60-90ce-1bc931864267","Type":"ContainerStarted","Data":"3cb5595a25ee9e7f84ab52fcf346ea81c795b937796e0383bc664d130eb5cdf1"}
Jul 16 18:19:40.284900 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:40.284860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/must-gather-pdgmb" event={"ID":"befb1cee-4af0-4d60-90ce-1bc931864267","Type":"ContainerStarted","Data":"eda14388324a3686d742a0d31ec5f3c08f5f3f26992fa3c13cc174acc69b1b1e"}
Jul 16 18:19:40.305582 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:40.305522    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w8h8n/must-gather-pdgmb" podStartSLOduration=2.534023297 podStartE2EDuration="3.305501393s" totalImagesPullingTime="771.478096ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:19:40.302674999 +0000 UTC m=+3059.819272935" watchObservedRunningTime="2026-07-16 18:19:40.305501393 +0000 UTC m=+3059.822099314"
Jul 16 18:19:40.906235 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:40.906205    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h69s6_06858021-a732-4a5d-963d-2fe4b6a8a696/global-pull-secret-syncer/0.log"
Jul 16 18:19:41.047514 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:41.047488    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vdttd_21a7a130-2b42-4fe8-b9b5-fdfe57f73a2c/konnectivity-agent/0.log"
Jul 16 18:19:41.097148 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:41.097106    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-187.ec2.internal_43acf0dee4ffc0ab3e3423a5eeb01c65/haproxy/0.log"
Jul 16 18:19:46.904530 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:46.904500    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-562t9_01d5540f-77a8-448d-93f6-184574c49015/limitador/0.log"
Jul 16 18:19:49.042175 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:49.042108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k76m_98fa2bb9-5fc6-4d63-951d-e8248da075b8/node-exporter/0.log"
Jul 16 18:19:49.067052 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:49.067022    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k76m_98fa2bb9-5fc6-4d63-951d-e8248da075b8/kube-rbac-proxy/0.log"
Jul 16 18:19:49.093639 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:49.093607    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k76m_98fa2bb9-5fc6-4d63-951d-e8248da075b8/init-textfile/0.log"
Jul 16 18:19:50.256554 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.256500    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"]
Jul 16 18:19:50.263050 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.262985    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.271792 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.271773    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"]
Jul 16 18:19:50.447191 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.447152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-lib-modules\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.447372 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.447206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jgqg\" (UniqueName: \"kubernetes.io/projected/a2f968da-72c8-45b2-9d74-2215b4517251-kube-api-access-8jgqg\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.447372 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.447268    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-podres\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.447372 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.447290    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-sys\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.447372 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.447311    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-proc\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548044 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-lib-modules\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548298 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jgqg\" (UniqueName: \"kubernetes.io/projected/a2f968da-72c8-45b2-9d74-2215b4517251-kube-api-access-8jgqg\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548492 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-podres\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548602 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548589    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-sys\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548709 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548695    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-proc\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548963 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-sys\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548963 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-lib-modules\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548963 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548759    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-podres\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.548963 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.548868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a2f968da-72c8-45b2-9d74-2215b4517251-proc\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.558821 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.558788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jgqg\" (UniqueName: \"kubernetes.io/projected/a2f968da-72c8-45b2-9d74-2215b4517251-kube-api-access-8jgqg\") pod \"perf-node-gather-daemonset-pvqzj\" (UID: \"a2f968da-72c8-45b2-9d74-2215b4517251\") " pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.575845 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.575811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:50.745279 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:50.745250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"]
Jul 16 18:19:50.748528 ip-10-0-134-187 kubenswrapper[2577]: W0716 18:19:50.748497    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda2f968da_72c8_45b2_9d74_2215b4517251.slice/crio-c942513b6a18f4eeea222f7f06197829cf3e1fee0da7cd37d796da95ddaea8a5 WatchSource:0}: Error finding container c942513b6a18f4eeea222f7f06197829cf3e1fee0da7cd37d796da95ddaea8a5: Status 404 returned error can't find the container with id c942513b6a18f4eeea222f7f06197829cf3e1fee0da7cd37d796da95ddaea8a5
Jul 16 18:19:51.049812 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.049736    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-cw6cs_cb380f66-6030-4163-9433-6b32861c4532/networking-console-plugin/0.log"
Jul 16 18:19:51.363470 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.362539    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj" event={"ID":"a2f968da-72c8-45b2-9d74-2215b4517251","Type":"ContainerStarted","Data":"082e019b0dd789ec17e9339f381884b17318e1ce16e3c291931baad07a23e633"}
Jul 16 18:19:51.363470 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.362604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj" event={"ID":"a2f968da-72c8-45b2-9d74-2215b4517251","Type":"ContainerStarted","Data":"c942513b6a18f4eeea222f7f06197829cf3e1fee0da7cd37d796da95ddaea8a5"}
Jul 16 18:19:51.363470 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.363358    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:19:51.386187 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.386130    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj" podStartSLOduration=1.386111434 podStartE2EDuration="1.386111434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:19:51.383598321 +0000 UTC m=+3070.900196254" watchObservedRunningTime="2026-07-16 18:19:51.386111434 +0000 UTC m=+3070.902709353"
Jul 16 18:19:51.602605 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.602568    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/1.log"
Jul 16 18:19:51.608552 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:51.608522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-dmw4k_5c18bd83-5189-4e2e-a1b4-1639b424383c/console-operator/2.log"
Jul 16 18:19:53.887991 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:53.887965    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-npbh7_fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd/dns/0.log"
Jul 16 18:19:53.912469 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:53.912418    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-npbh7_fc1b7b02-5c48-47c9-8e71-0cf4fa0794dd/kube-rbac-proxy/0.log"
Jul 16 18:19:54.049837 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:54.049813    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pl2dk_93b8d26c-2622-42d2-8114-24f24049e3e3/dns-node-resolver/0.log"
Jul 16 18:19:54.756455 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:54.756425    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nx2hc_a4d9fc90-1881-4726-ac31-23e07c377c50/node-ca/0.log"
Jul 16 18:19:55.934086 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:55.934058    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qwfrj_dae69b9d-3503-4e8a-96b9-bc9f4cefaaea/discovery/0.log"
Jul 16 18:19:56.929046 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:56.929016    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-td5rp_8eba30df-7191-4311-9785-21b323d740f9/serve-healthcheck-canary/0.log"
Jul 16 18:19:57.486449 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:57.486417    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6kkjt_5570d77d-a138-4451-a204-e3e69019603e/insights-operator/0.log"
Jul 16 18:19:57.487062 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:57.487042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-6kkjt_5570d77d-a138-4451-a204-e3e69019603e/insights-operator/1.log"
Jul 16 18:19:57.599918 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:57.599892    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtpl9_ce7ddb54-c70f-4477-9e48-10af684a35ab/kube-rbac-proxy/0.log"
Jul 16 18:19:57.626628 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:57.626601    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtpl9_ce7ddb54-c70f-4477-9e48-10af684a35ab/exporter/0.log"
Jul 16 18:19:57.653019 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:57.652996    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jtpl9_ce7ddb54-c70f-4477-9e48-10af684a35ab/extractor/0.log"
Jul 16 18:19:58.387585 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:19:58.387558    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w8h8n/perf-node-gather-daemonset-pvqzj"
Jul 16 18:20:00.712846 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:00.712806    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qwfrj_dae69b9d-3503-4e8a-96b9-bc9f4cefaaea/discovery/0.log"
Jul 16 18:20:00.845059 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:00.845026    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-q6d7n_af1f70fa-05b5-4c80-85a6-ff22aba7eeb3/manager/0.log"
Jul 16 18:20:00.870393 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:00.870360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-586f4b4fcb-q6d7n_af1f70fa-05b5-4c80-85a6-ff22aba7eeb3/copy-manifests/0.log"
Jul 16 18:20:02.288989 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:02.288947    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55f946f648-r22jc_8e53ac5c-a837-4523-a295-36b9526bdecc/manager/0.log"
Jul 16 18:20:02.326310 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:02.326282    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-qd5fp_22172724-1f7b-465e-ac8c-adf306196a06/openshift-lws-operator/0.log"
Jul 16 18:20:02.433983 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:02.433948    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qwfrj_dae69b9d-3503-4e8a-96b9-bc9f4cefaaea/discovery/0.log"
Jul 16 18:20:07.426280 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:07.426244    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-z4bhg_bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052/migrator/0.log"
Jul 16 18:20:07.453551 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:07.453520    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-z4bhg_bd8b6063-ec7c-4da4-a86a-ed2fc2e7c052/graceful-termination/0.log"
Jul 16 18:20:07.866741 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:07.866693    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-99ncm_49a0d014-8620-44af-9fe7-0c48ab148bd3/kube-storage-version-migrator-operator/1.log"
Jul 16 18:20:07.867519 ip-10-0-134-187 kubenswrapper[2577]: I0716 18:20:07.867498    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-99ncm_49a0d014-8620-44af-9fe7-0c48ab148bd3/kube-storage-version-migrator-operator/0.log"